Max level shown:
12024-08-22T03:15:00.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9d40147f-f44a-451f-8a84-780bc876b011 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
22024-08-22T03:15:00.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9d40147f-f44a-451f-8a84-780bc876b011 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32024-08-22T03:15:00.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2534 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9d40147f-f44a-451f-8a84-780bc876b011 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
42024-08-22T03:15:01.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b902b6b4-0805-4d6d-ba27-045ced032855 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52024-08-22T03:15:01.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b902b6b4-0805-4d6d-ba27-045ced032855 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62024-08-22T03:15:01.824ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b902b6b4-0805-4d6d-ba27-045ced032855 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72024-08-22T03:15:01.969ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:35284
82024-08-22T03:15:01.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35284 req_id = 2a4d09d1-b224-4465-b80b-b6aafa98cb98 roles = RoleSet { roles: {} } uri = /metrics/producers
92024-08-22T03:15:01.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35284 req_id = 2a4d09d1-b224-4465-b80b-b6aafa98cb98 resource = Database result = Ok(()) uri = /metrics/producers
102024-08-22T03:15:02.002ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
112024-08-22T03:15:02.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35284 req_id = 2a4d09d1-b224-4465-b80b-b6aafa98cb98 roles = RoleSet { roles: {} } uri = /metrics/producers
122024-08-22T03:15:02.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35284 req_id = 2a4d09d1-b224-4465-b80b-b6aafa98cb98 resource = Database result = Ok(()) uri = /metrics/producers
132024-08-22T03:15:02.009ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
142024-08-22T03:15:02.009ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "97b60d33-27ea-43e0-aa5c-4ff1ad076b06", "date": "Thu, 22 Aug 2024 03:15:02 GMT"} })
152024-08-22T03:15:02.009ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = b136e605-e6c0-4cdf-94cc-94880650b9fc
162024-08-22T03:15:02.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41856 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35284 req_id = 2a4d09d1-b224-4465-b80b-b6aafa98cb98 response_code = 201 uri = /metrics/producers
172024-08-22T03:15:02.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 47ce630b-5e72-45b3-82d3-2310694c64a0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
182024-08-22T03:15:02.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 47ce630b-5e72-45b3-82d3-2310694c64a0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
192024-08-22T03:15:02.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 47ce630b-5e72-45b3-82d3-2310694c64a0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
202024-08-22T03:15:03.232ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
212024-08-22T03:15:03.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
222024-08-22T03:15:03.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
232024-08-22T03:15:03.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
242024-08-22T03:15:03.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
252024-08-22T03:15:03.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
262024-08-22T03:15:03.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
272024-08-22T03:15:03.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
282024-08-22T03:15:03.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
292024-08-22T03:15:03.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
302024-08-22T03:15:03.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
312024-08-22T03:15:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
322024-08-22T03:15:03.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
332024-08-22T03:15:03.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
342024-08-22T03:15:03.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.153409ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
352024-08-22T03:15:03.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
362024-08-22T03:15:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
372024-08-22T03:15:03.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
382024-08-22T03:15:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
392024-08-22T03:15:03.250ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
402024-08-22T03:15:03.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.228116ms iteration = 17 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
412024-08-22T03:15:03.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = daa56049-5eb2-4753-ac91-371f15fa334c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
422024-08-22T03:15:03.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = daa56049-5eb2-4753-ac91-371f15fa334c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
432024-08-22T03:15:03.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = daa56049-5eb2-4753-ac91-371f15fa334c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
442024-08-22T03:15:04.372ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1439 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 7ed49d57-4fe6-4165-882c-a9189d969c22 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
452024-08-22T03:15:04.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c491d879-f9d3-4928-bd96-a4703b2de7c3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
462024-08-22T03:15:04.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c491d879-f9d3-4928-bd96-a4703b2de7c3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
472024-08-22T03:15:04.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c491d879-f9d3-4928-bd96-a4703b2de7c3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
482024-08-22T03:15:05.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3840ba2c-1af2-4827-8a01-12c612764610 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
492024-08-22T03:15:05.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3840ba2c-1af2-4827-8a01-12c612764610 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
502024-08-22T03:15:05.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3840ba2c-1af2-4827-8a01-12c612764610 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
512024-08-22T03:15:06.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b88f57d5-700b-4d24-be46-81bde3b0ac48 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
522024-08-22T03:15:06.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b88f57d5-700b-4d24-be46-81bde3b0ac48 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
532024-08-22T03:15:06.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b88f57d5-700b-4d24-be46-81bde3b0ac48 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
542024-08-22T03:15:07.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 594b2ecd-6ca5-4c44-83be-749817a4c165 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
552024-08-22T03:15:07.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 594b2ecd-6ca5-4c44-83be-749817a4c165 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
562024-08-22T03:15:07.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 594b2ecd-6ca5-4c44-83be-749817a4c165 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
572024-08-22T03:15:08.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c1cdb243-5ec3-4a44-83ad-a4f201971db0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
582024-08-22T03:15:08.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c1cdb243-5ec3-4a44-83ad-a4f201971db0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
592024-08-22T03:15:08.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1844 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c1cdb243-5ec3-4a44-83ad-a4f201971db0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
602024-08-22T03:15:09.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 95416993-c794-465e-99d9-7eb289494c1e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
612024-08-22T03:15:09.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 95416993-c794-465e-99d9-7eb289494c1e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
622024-08-22T03:15:09.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 95416993-c794-465e-99d9-7eb289494c1e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
632024-08-22T03:15:11.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 09411a24-ae2f-42f4-bc2f-0c996ebf0c97 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
642024-08-22T03:15:11.018ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 09411a24-ae2f-42f4-bc2f-0c996ebf0c97 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
652024-08-22T03:15:11.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2181 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 09411a24-ae2f-42f4-bc2f-0c996ebf0c97 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
662024-08-22T03:15:12.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 585adb65-602d-4fea-ba7b-429f5931037e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
672024-08-22T03:15:12.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 585adb65-602d-4fea-ba7b-429f5931037e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
682024-08-22T03:15:12.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 585adb65-602d-4fea-ba7b-429f5931037e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
692024-08-22T03:15:13.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e7e1a5fc-8343-4d50-9fbe-a44e029f1e3a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
702024-08-22T03:15:13.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e7e1a5fc-8343-4d50-9fbe-a44e029f1e3a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
712024-08-22T03:15:13.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e7e1a5fc-8343-4d50-9fbe-a44e029f1e3a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
722024-08-22T03:15:13.233ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
732024-08-22T03:15:13.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
742024-08-22T03:15:13.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
752024-08-22T03:15:13.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
762024-08-22T03:15:13.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
772024-08-22T03:15:13.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
782024-08-22T03:15:13.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
792024-08-22T03:15:13.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
802024-08-22T03:15:13.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
812024-08-22T03:15:13.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
822024-08-22T03:15:13.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
832024-08-22T03:15:13.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
842024-08-22T03:15:13.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
852024-08-22T03:15:13.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
862024-08-22T03:15:13.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.167279ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
872024-08-22T03:15:13.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
882024-08-22T03:15:13.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
892024-08-22T03:15:13.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
902024-08-22T03:15:13.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
912024-08-22T03:15:13.250ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
922024-08-22T03:15:13.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.473027ms iteration = 18 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
932024-08-22T03:15:14.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8cd25d7d-e461-4939-9708-89cb49ab73e8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
942024-08-22T03:15:14.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8cd25d7d-e461-4939-9708-89cb49ab73e8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
952024-08-22T03:15:14.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8cd25d7d-e461-4939-9708-89cb49ab73e8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
962024-08-22T03:15:14.373ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1419 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 370b8465-59ab-4ade-97ef-dd7d25d7375d response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
972024-08-22T03:15:15.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8adea377-eede-4d3d-becb-1e0fdb5194b3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
982024-08-22T03:15:15.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8adea377-eede-4d3d-becb-1e0fdb5194b3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
992024-08-22T03:15:15.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8adea377-eede-4d3d-becb-1e0fdb5194b3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1002024-08-22T03:15:16.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f3075a37-12f7-4e57-adbd-cbb79f325fdd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1012024-08-22T03:15:16.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f3075a37-12f7-4e57-adbd-cbb79f325fdd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1022024-08-22T03:15:16.127ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f3075a37-12f7-4e57-adbd-cbb79f325fdd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1032024-08-22T03:15:17.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49e05e86-6ebc-4ef5-979e-4863d1d593cb roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1042024-08-22T03:15:17.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49e05e86-6ebc-4ef5-979e-4863d1d593cb resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1052024-08-22T03:15:17.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49e05e86-6ebc-4ef5-979e-4863d1d593cb response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1062024-08-22T03:15:18.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3083fc7e-790b-4c11-a883-3ab9cb5bc966 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1072024-08-22T03:15:18.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3083fc7e-790b-4c11-a883-3ab9cb5bc966 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1082024-08-22T03:15:18.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3083fc7e-790b-4c11-a883-3ab9cb5bc966 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1092024-08-22T03:15:19.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 793d528b-fb88-4745-aec3-503a93d54445 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1102024-08-22T03:15:19.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 793d528b-fb88-4745-aec3-503a93d54445 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1112024-08-22T03:15:19.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 793d528b-fb88-4745-aec3-503a93d54445 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1122024-08-22T03:15:20.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9ad2ef30-a44d-4529-8bd8-15b3d946de7f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1132024-08-22T03:15:20.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9ad2ef30-a44d-4529-8bd8-15b3d946de7f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1142024-08-22T03:15:20.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9ad2ef30-a44d-4529-8bd8-15b3d946de7f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1152024-08-22T03:15:21.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c97f4901-ae60-4da9-97c6-16757b6dcc9c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1162024-08-22T03:15:21.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c97f4901-ae60-4da9-97c6-16757b6dcc9c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1172024-08-22T03:15:21.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c97f4901-ae60-4da9-97c6-16757b6dcc9c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1182024-08-22T03:15:22.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f6d1cfbe-556c-4a7e-b8d8-2b1279a9d5a5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1192024-08-22T03:15:22.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f6d1cfbe-556c-4a7e-b8d8-2b1279a9d5a5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1202024-08-22T03:15:22.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f6d1cfbe-556c-4a7e-b8d8-2b1279a9d5a5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
1212024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
1222024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
1232024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
1242024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
1252024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
1262024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
1272024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
1282024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1292024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
1302024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
1312024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1322024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
1332024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
1342024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
1352024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
1362024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1372024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
1382024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
1392024-08-22T03:15:23.234ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = bff907f0-2101-418e-8f5d-955661c8bd6f
1402024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
1412024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.521\u{b5}s iteration = 5 status = {"error":"blueprint disabled","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f"}
1422024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1432024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
1442024-08-22T03:15:23.234ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-22 03:05:23.234456650 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
1452024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
1462024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
1472024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1482024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
1492024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1502024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
1512024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1522024-08-22T03:15:23.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1532024-08-22T03:15:23.235ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3ce7517f-82f9-4849-ad08-7cb0bf67f024.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 759429138 } })
1542024-08-22T03:15:23.235ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1467044e-2fe8-4015-be86-a3faa36f1469.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64fff417-46fd-44ed-ac7e-a3829d9efa54.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 759489219 } })
1552024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
1562024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
1572024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1582024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1592024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
1602024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1612024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1622024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1632024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
1642024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1652024-08-22T03:15:23.235ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1662024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1672024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1682024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1692024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1702024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
1712024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
1722024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
1732024-08-22T03:15:23.236ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
1742024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1752024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
1762024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
1772024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1782024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
1792024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
1802024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
1812024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1822024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
1832024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1842024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
1852024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
1862024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1872024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1882024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
1892024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
1902024-08-22T03:15:23.236ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
1912024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
1922024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
1932024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1942024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1952024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
1962024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1972024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
1982024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1992024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
2002024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
2012024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2022024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
2032024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2042024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
2052024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
2062024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2072024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2082024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2092024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2102024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2112024-08-22T03:15:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2122024-08-22T03:15:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
2132024-08-22T03:15:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2142024-08-22T03:15:23.237ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
2152024-08-22T03:15:23.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.664504ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
2162024-08-22T03:15:23.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2172024-08-22T03:15:23.237ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.934977ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
2182024-08-22T03:15:23.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2192024-08-22T03:15:23.237ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-22 03:05:23.234456650 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
2202024-08-22T03:15:23.237ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.260941ms iteration = 4 status = {"expiration":"2024-08-22T03:05:23.234456650Z","pruned":[]}
2212024-08-22T03:15:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2222024-08-22T03:15:23.238ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
2232024-08-22T03:15:23.238ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.742217ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
2242024-08-22T03:15:23.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2252024-08-22T03:15:23.238ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
2262024-08-22T03:15:23.238ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2272024-08-22T03:15:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2282024-08-22T03:15:23.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2292024-08-22T03:15:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2302024-08-22T03:15:23.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2312024-08-22T03:15:23.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2322024-08-22T03:15:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2332024-08-22T03:15:23.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2342024-08-22T03:15:23.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 764125858 } })
2352024-08-22T03:15:23.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2362024-08-22T03:15:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2372024-08-22T03:15:23.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2382024-08-22T03:15:23.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
2392024-08-22T03:15:23.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 765259932 } })
2402024-08-22T03:15:23.241ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2412024-08-22T03:15:23.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2422024-08-22T03:15:23.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
2432024-08-22T03:15:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2442024-08-22T03:15:23.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2452024-08-22T03:15:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2462024-08-22T03:15:23.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2472024-08-22T03:15:23.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2482024-08-22T03:15:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2492024-08-22T03:15:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2502024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2512024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2522024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2542024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2552024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2562024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2572024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2582024-08-22T03:15:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
2592024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
2602024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2612024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
2622024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
2632024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
2642024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
2652024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2662024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2672024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
2682024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
2692024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
2702024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
2712024-08-22T03:15:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
2722024-08-22T03:15:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
2732024-08-22T03:15:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
2742024-08-22T03:15:23.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
2752024-08-22T03:15:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2762024-08-22T03:15:23.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2772024-08-22T03:15:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2782024-08-22T03:15:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
2792024-08-22T03:15:23.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 9.5299ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2802024-08-22T03:15:23.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2812024-08-22T03:15:23.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2822024-08-22T03:15:23.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2832024-08-22T03:15:23.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2842024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2852024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
2862024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
2872024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2882024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2892024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2902024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
2912024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
2922024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2932024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
2942024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2952024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2962024-08-22T03:15:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
2972024-08-22T03:15:23.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2982024-08-22T03:15:23.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2992024-08-22T03:15:23.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.228454ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
3002024-08-22T03:15:23.249ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3012024-08-22T03:15:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
3022024-08-22T03:15:23.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
3032024-08-22T03:15:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3042024-08-22T03:15:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
3052024-08-22T03:15:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
3062024-08-22T03:15:23.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3072024-08-22T03:15:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3082024-08-22T03:15:23.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3092024-08-22T03:15:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3102024-08-22T03:15:23.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3112024-08-22T03:15:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3122024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3132024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3142024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3152024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3162024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3172024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3182024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3192024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
3202024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3212024-08-22T03:15:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3222024-08-22T03:15:23.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
3232024-08-22T03:15:23.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3242024-08-22T03:15:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
3252024-08-22T03:15:23.252ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
3262024-08-22T03:15:23.252ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 0 version = 2
3272024-08-22T03:15:23.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3282024-08-22T03:15:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3292024-08-22T03:15:23.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
3302024-08-22T03:15:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
3312024-08-22T03:15:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3322024-08-22T03:15:23.253ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3332024-08-22T03:15:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3342024-08-22T03:15:23.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3352024-08-22T03:15:23.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 18.230439ms iteration = 7 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
3362024-08-22T03:15:23.255ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
3372024-08-22T03:15:23.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.198366ms iteration = 19 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
3382024-08-22T03:15:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
3392024-08-22T03:15:23.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3402024-08-22T03:15:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
3412024-08-22T03:15:23.260ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 24.973964ms iteration = 10 status = {"physical_disks_added":0}
3422024-08-22T03:15:23.260ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
3432024-08-22T03:15:23.260ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
3442024-08-22T03:15:23.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3452024-08-22T03:15:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3462024-08-22T03:15:23.261ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
3472024-08-22T03:15:23.261ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
3482024-08-22T03:15:23.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
3492024-08-22T03:15:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
3502024-08-22T03:15:23.261ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 1 version = 2
3512024-08-22T03:15:23.261ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
3522024-08-22T03:15:23.261ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-22 03:13:03.125979 UTC dns_group = external generation = 2
3532024-08-22T03:15:23.261ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 26.960058ms iteration = 5 status = {"generation":2}
3542024-08-22T03:15:23.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3552024-08-22T03:15:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
3562024-08-22T03:15:23.263ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
3572024-08-22T03:15:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
3582024-08-22T03:15:23.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3592024-08-22T03:15:23.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3602024-08-22T03:15:23.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
3612024-08-22T03:15:23.267ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
3622024-08-22T03:15:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
3632024-08-22T03:15:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
3642024-08-22T03:15:23.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
3652024-08-22T03:15:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
3662024-08-22T03:15:23.270ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
3672024-08-22T03:15:23.270ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
3682024-08-22T03:15:23.270ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-22 03:13:02.692706 UTC dns_group = internal generation = 1
3692024-08-22T03:15:23.270ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 36.060013ms iteration = 5 status = {"generation":1}
3702024-08-22T03:15:23.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3712024-08-22T03:15:23.270ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 35.285104ms iteration = 3 status = {"nsuccess":5}
3722024-08-22T03:15:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3732024-08-22T03:15:23.270ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1227, tv_nsec: 795253889 } })
3742024-08-22T03:15:23.271ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
3752024-08-22T03:15:23.271ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
3762024-08-22T03:15:23.271ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.830698ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
3772024-08-22T03:15:23.272ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 35.72787ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
3782024-08-22T03:15:23.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3792024-08-22T03:15:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3802024-08-22T03:15:23.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3812024-08-22T03:15:23.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 98b17b2e-c29c-4691-8774-80aeb2d12325 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
3822024-08-22T03:15:23.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 98b17b2e-c29c-4691-8774-80aeb2d12325 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
3832024-08-22T03:15:23.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1703 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 98b17b2e-c29c-4691-8774-80aeb2d12325 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
3842024-08-22T03:15:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
3852024-08-22T03:15:23.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
3862024-08-22T03:15:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
3872024-08-22T03:15:23.278ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 41.832946ms iteration = 7 status = 0
3882024-08-22T03:15:23.280ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 43.937942ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
3892024-08-22T03:15:23.286ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
3902024-08-22T03:15:23.286ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
3912024-08-22T03:15:23.286ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 50.392723ms iteration = 4 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
3922024-08-22T03:15:23.295ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
3932024-08-22T03:15:23.295ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
3942024-08-22T03:15:23.295ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 58.570336ms iteration = 7 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
3952024-08-22T03:15:23.303ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
3962024-08-22T03:15:23.303ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
3972024-08-22T03:15:23.303ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 66.887981ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
3982024-08-22T03:15:23.304ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-22T03:12:22.052278Z, time_modified: 2024-08-22T03:12:22.052278Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }) }
3992024-08-22T03:15:23.305ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 70.691869ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]}},"default_endpoint":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
4002024-08-22T03:15:23.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
4012024-08-22T03:15:23.428ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
4022024-08-22T03:15:23.428ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4032024-08-22T03:15:23.429ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1f0a79cb-6975-4a15-b254-f96a4437cec4", "content-length": "26", "date": "Thu, 22 Aug 2024 03:15:22 GMT"} })
4042024-08-22T03:15:23.429ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4052024-08-22T03:15:23.430ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4062024-08-22T03:15:23.444ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4072024-08-22T03:15:23.451ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
4082024-08-22T03:15:23.452ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4092024-08-22T03:15:23.452ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fc693e8a-6b7d-4128-ad81-3a681e13407d", "content-length": "26", "date": "Thu, 22 Aug 2024 03:15:22 GMT"} })
4102024-08-22T03:15:23.452ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4112024-08-22T03:15:23.454ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
4122024-08-22T03:15:23.454ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4132024-08-22T03:15:23.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4142024-08-22T03:15:23.473ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f17c9f2a-e0ff-4f40-acc4-3f0d240d26c4", "content-length": "372", "date": "Thu, 22 Aug 2024 03:15:22 GMT"} })
4152024-08-22T03:15:23.473ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4162024-08-22T03:15:23.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4172024-08-22T03:15:23.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4182024-08-22T03:15:23.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4192024-08-22T03:15:23.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4202024-08-22T03:15:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4212024-08-22T03:15:23.480ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
4222024-08-22T03:15:23.481ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d6277f9f-9eca-4f38-826e-2f62eb550188", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} })
4232024-08-22T03:15:23.483ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 247.192298ms iteration = 8 status = {}
4242024-08-22T03:15:23.491ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4252024-08-22T03:15:23.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4262024-08-22T03:15:23.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4272024-08-22T03:15:23.493ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4282024-08-22T03:15:23.493ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4292024-08-22T03:15:23.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4302024-08-22T03:15:23.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4312024-08-22T03:15:23.496ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
4322024-08-22T03:15:23.496ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4332024-08-22T03:15:23.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4342024-08-22T03:15:23.522ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
4352024-08-22T03:15:23.540ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
4362024-08-22T03:15:23.540ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6a002d99-c375-4810-9afc-9cba7e039e0c", "date": "Thu, 22 Aug 2024 03:15:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4372024-08-22T03:15:23.540ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4382024-08-22T03:15:23.542ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c7672028-a3c6-4778-bec2-645176e726d6", "date": "Thu, 22 Aug 2024 03:15:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4392024-08-22T03:15:23.542ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4402024-08-22T03:15:23.543ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
4412024-08-22T03:15:23.543ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 309.709263ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
4422024-08-22T03:15:23.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = ec87a77e-8970-4f46-ae5c-0d6b4cf25388 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
4432024-08-22T03:15:23.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = ec87a77e-8970-4f46-ae5c-0d6b4cf25388 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
4442024-08-22T03:15:23.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = ec87a77e-8970-4f46-ae5c-0d6b4cf25388 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
4452024-08-22T03:15:23.571ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
4462024-08-22T03:15:23.571ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
4472024-08-22T03:15:23.571ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a81f46af-f93f-49be-bf8a-10d10e7dd28c", "content-length": "26", "date": "Thu, 22 Aug 2024 03:15:22 GMT"} })
4482024-08-22T03:15:23.571ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
4492024-08-22T03:15:23.573ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
4502024-08-22T03:15:23.696ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
4512024-08-22T03:15:23.738ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
4522024-08-22T03:15:23.738ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8f40462e-3274-495e-9fdf-0944b0a1a97e", "content-length": "1", "date": "Thu, 22 Aug 2024 03:15:22 GMT"} })
4532024-08-22T03:15:23.740ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4542024-08-22T03:15:23.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4552024-08-22T03:15:23.743ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 509.159991ms iteration = 7 status = null
4562024-08-22T03:15:23.788ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 554.227618ms iteration = 7 status = {}
4572024-08-22T03:15:23.827ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
4582024-08-22T03:15:23.828ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "de0897ed-c269-4f91-aca1-2e8010da2a21", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4592024-08-22T03:15:23.828ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4602024-08-22T03:15:23.828ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
4612024-08-22T03:15:23.829ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e1cca357-c471-478b-8648-cfcccf0c52a5", "content-length": "691", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} })
4622024-08-22T03:15:23.829ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
4632024-08-22T03:15:23.829ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
4642024-08-22T03:15:23.829ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
4652024-08-22T03:15:23.830ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d76da5ad-9017-4a60-bcbf-359993d4fff1", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4662024-08-22T03:15:23.830ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4672024-08-22T03:15:23.831ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 595.264274ms iteration = 7 status = {}
4682024-08-22T03:15:23.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "349ab100-3f16-434c-b99d-b77640a6dffa", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4692024-08-22T03:15:23.832ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4702024-08-22T03:15:23.834ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
4712024-08-22T03:15:23.834ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 600.52348ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
4722024-08-22T03:15:23.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4732024-08-22T03:15:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4742024-08-22T03:15:23.892ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
4752024-08-22T03:15:23.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4762024-08-22T03:15:23.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4772024-08-22T03:15:23.900ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
4782024-08-22T03:15:23.901ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "04807169-2d9d-4311-bc3b-e4270651a85c", "content-length": "121", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} })
4792024-08-22T03:15:23.901ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
4802024-08-22T03:15:23.901ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
4812024-08-22T03:15:23.901ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4822024-08-22T03:15:23.901ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
4832024-08-22T03:15:23.901ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
4842024-08-22T03:15:23.901ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
4852024-08-22T03:15:23.901ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
4862024-08-22T03:15:23.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4872024-08-22T03:15:23.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4882024-08-22T03:15:23.903ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
4892024-08-22T03:15:23.903ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "155c95a8-8f0b-41e6-bf39-9aa9e7281ceb", "content-length": "2", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} })
4902024-08-22T03:15:23.903ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
4912024-08-22T03:15:23.903ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e5bf19d5-bbfe-4af2-a02a-6dbcc4bbae43", "content-length": "51", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} })
4922024-08-22T03:15:23.903ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
4932024-08-22T03:15:23.903ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
4942024-08-22T03:15:23.997ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "52e23a09-8e0b-4220-a4b5-b35a7055f361", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} })
4952024-08-22T03:15:23.997ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
4962024-08-22T03:15:23.997ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
4972024-08-22T03:15:24.000ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "28f95898-a6e4-4c6c-a882-b14997510142", "content-length": "667", "date": "Thu, 22 Aug 2024 03:15:23 GMT"} })
4982024-08-22T03:15:24.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4992024-08-22T03:15:24.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5002024-08-22T03:15:24.004ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5012024-08-22T03:15:24.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5022024-08-22T03:15:24.007ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5032024-08-22T03:15:24.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5042024-08-22T03:15:24.008ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5052024-08-22T03:15:24.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5062024-08-22T03:15:24.016ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 779.879555ms iteration = 7 status = {}
5072024-08-22T03:15:24.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce8e982f-3fdc-4500-8902-e4c2e997be59 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5082024-08-22T03:15:24.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce8e982f-3fdc-4500-8902-e4c2e997be59 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5092024-08-22T03:15:24.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce8e982f-3fdc-4500-8902-e4c2e997be59 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5102024-08-22T03:15:24.373ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 598de7d2-5c60-4aae-b0e8-5ce74c488993 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
5112024-08-22T03:15:25.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 47554982-9018-4535-b452-6466b63adc79 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5122024-08-22T03:15:25.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 47554982-9018-4535-b452-6466b63adc79 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5132024-08-22T03:15:25.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 47554982-9018-4535-b452-6466b63adc79 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5142024-08-22T03:15:26.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4ab661bc-ee91-415d-8b9b-710db9c7fca8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5152024-08-22T03:15:26.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4ab661bc-ee91-415d-8b9b-710db9c7fca8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5162024-08-22T03:15:26.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4ab661bc-ee91-415d-8b9b-710db9c7fca8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5172024-08-22T03:15:27.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dfea1db5-a8bf-480c-beae-ff08eac3e51b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5182024-08-22T03:15:27.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dfea1db5-a8bf-480c-beae-ff08eac3e51b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5192024-08-22T03:15:27.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dfea1db5-a8bf-480c-beae-ff08eac3e51b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5202024-08-22T03:15:28.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c3008278-5c98-4e1b-ae6f-20edb6f93610 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5212024-08-22T03:15:28.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c3008278-5c98-4e1b-ae6f-20edb6f93610 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5222024-08-22T03:15:28.383ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c3008278-5c98-4e1b-ae6f-20edb6f93610 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5232024-08-22T03:15:29.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 235e217a-ba04-4333-a1d8-87250fb34a3f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5242024-08-22T03:15:29.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 235e217a-ba04-4333-a1d8-87250fb34a3f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5252024-08-22T03:15:29.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2661 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 235e217a-ba04-4333-a1d8-87250fb34a3f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5262024-08-22T03:15:30.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 039bf1a4-e559-4ad3-a560-69cda76aafc0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5272024-08-22T03:15:30.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 039bf1a4-e559-4ad3-a560-69cda76aafc0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5282024-08-22T03:15:30.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 039bf1a4-e559-4ad3-a560-69cda76aafc0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5292024-08-22T03:15:31.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = de961b7d-4cb0-4582-8d3f-de955d99aeb7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5302024-08-22T03:15:31.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = de961b7d-4cb0-4582-8d3f-de955d99aeb7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5312024-08-22T03:15:31.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = de961b7d-4cb0-4582-8d3f-de955d99aeb7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5322024-08-22T03:15:32.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 083ebb0d-d81f-417a-a8a5-7e39c35978ec roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5332024-08-22T03:15:32.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 083ebb0d-d81f-417a-a8a5-7e39c35978ec resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5342024-08-22T03:15:32.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 083ebb0d-d81f-417a-a8a5-7e39c35978ec response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5352024-08-22T03:15:33.234ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
5362024-08-22T03:15:33.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5372024-08-22T03:15:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5382024-08-22T03:15:33.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5392024-08-22T03:15:33.236ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
5402024-08-22T03:15:33.236ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5412024-08-22T03:15:33.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5422024-08-22T03:15:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5432024-08-22T03:15:33.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5442024-08-22T03:15:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5452024-08-22T03:15:33.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5462024-08-22T03:15:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5472024-08-22T03:15:33.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.914317ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
5482024-08-22T03:15:33.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5492024-08-22T03:15:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5502024-08-22T03:15:33.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-08-22T03:15:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
5522024-08-22T03:15:33.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5532024-08-22T03:15:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5542024-08-22T03:15:33.248ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
5552024-08-22T03:15:33.248ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.575793ms iteration = 20 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
5562024-08-22T03:15:33.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6ac935d9-33ff-44b5-bfab-d4b8ee9b9e45 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5572024-08-22T03:15:33.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6ac935d9-33ff-44b5-bfab-d4b8ee9b9e45 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5582024-08-22T03:15:33.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6ac935d9-33ff-44b5-bfab-d4b8ee9b9e45 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5592024-08-22T03:15:34.340ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
5602024-08-22T03:15:34.340ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
5612024-08-22T03:15:34.370ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
5622024-08-22T03:15:34.370ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:57918
5632024-08-22T03:15:34.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57918 req_id = 9557fa71-2326-48f9-ac02-8e1b19893302 roles = RoleSet { roles: {} } uri = /metrics/producers
5642024-08-22T03:15:34.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57918 req_id = 9557fa71-2326-48f9-ac02-8e1b19893302 resource = Database result = Ok(()) uri = /metrics/producers
5652024-08-22T03:15:34.373ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1554 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 81933cda-2c10-4750-83de-16161395331d response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
5662024-08-22T03:15:34.403ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
5672024-08-22T03:15:34.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57918 req_id = 9557fa71-2326-48f9-ac02-8e1b19893302 roles = RoleSet { roles: {} } uri = /metrics/producers
5682024-08-22T03:15:34.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57918 req_id = 9557fa71-2326-48f9-ac02-8e1b19893302 resource = Database result = Ok(()) uri = /metrics/producers
5692024-08-22T03:15:34.436ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
5702024-08-22T03:15:34.436ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "945ace4c-8449-4d06-b95b-87b174106153", "date": "Thu, 22 Aug 2024 03:15:34 GMT"} })
5712024-08-22T03:15:34.436ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
5722024-08-22T03:15:34.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 66778 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:57918 req_id = 9557fa71-2326-48f9-ac02-8e1b19893302 response_code = 201 uri = /metrics/producers
5732024-08-22T03:15:34.437ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "9557fa71-2326-48f9-ac02-8e1b19893302", "content-length": "41", "date": "Thu, 22 Aug 2024 03:15:33 GMT"} })
5742024-08-22T03:15:34.439ZDEBGnexus (producer-registration-task): registered with nexus successfully
5752024-08-22T03:15:34.439ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
5762024-08-22T03:15:34.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6a9d545d-cc14-41e0-b785-de327bb9e9db roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5772024-08-22T03:15:34.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6a9d545d-cc14-41e0-b785-de327bb9e9db resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5782024-08-22T03:15:34.511ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6a9d545d-cc14-41e0-b785-de327bb9e9db response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5792024-08-22T03:15:35.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8ea74dd0-3b08-4bcd-803e-ae229cd0444c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5802024-08-22T03:15:35.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8ea74dd0-3b08-4bcd-803e-ae229cd0444c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5812024-08-22T03:15:35.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8ea74dd0-3b08-4bcd-803e-ae229cd0444c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5822024-08-22T03:15:36.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d79c7d97-bebc-4abb-8f79-8d4712ee0c68 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5832024-08-22T03:15:36.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d79c7d97-bebc-4abb-8f79-8d4712ee0c68 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5842024-08-22T03:15:36.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2009 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d79c7d97-bebc-4abb-8f79-8d4712ee0c68 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5852024-08-22T03:15:37.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 551f0ff1-b050-4811-b475-c0882f715698 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5862024-08-22T03:15:37.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 551f0ff1-b050-4811-b475-c0882f715698 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5872024-08-22T03:15:37.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 551f0ff1-b050-4811-b475-c0882f715698 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5882024-08-22T03:15:38.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18ff0271-0e1b-4695-a321-9c197cec2811 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5892024-08-22T03:15:38.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18ff0271-0e1b-4695-a321-9c197cec2811 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5902024-08-22T03:15:38.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18ff0271-0e1b-4695-a321-9c197cec2811 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5912024-08-22T03:15:39.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c0842f54-fce4-4f29-b7ae-35b8809b805c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5922024-08-22T03:15:39.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c0842f54-fce4-4f29-b7ae-35b8809b805c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5932024-08-22T03:15:39.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c0842f54-fce4-4f29-b7ae-35b8809b805c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5942024-08-22T03:15:40.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 72f9f102-4a4a-468d-b053-adad231dfb4f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5952024-08-22T03:15:40.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 72f9f102-4a4a-468d-b053-adad231dfb4f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5962024-08-22T03:15:40.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 72f9f102-4a4a-468d-b053-adad231dfb4f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5972024-08-22T03:15:41.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = abac3302-4cff-405f-a093-bd0e842c6e0c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5982024-08-22T03:15:41.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = abac3302-4cff-405f-a093-bd0e842c6e0c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
5992024-08-22T03:15:41.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = abac3302-4cff-405f-a093-bd0e842c6e0c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6002024-08-22T03:15:42.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d81798b-63ee-46dd-9c6f-e34ec4849a10 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6012024-08-22T03:15:42.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d81798b-63ee-46dd-9c6f-e34ec4849a10 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6022024-08-22T03:15:42.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d81798b-63ee-46dd-9c6f-e34ec4849a10 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6032024-08-22T03:15:43.234ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
6042024-08-22T03:15:43.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6052024-08-22T03:15:43.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6062024-08-22T03:15:43.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6072024-08-22T03:15:43.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
6082024-08-22T03:15:43.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6092024-08-22T03:15:43.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6102024-08-22T03:15:43.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6112024-08-22T03:15:43.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6122024-08-22T03:15:43.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6132024-08-22T03:15:43.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6142024-08-22T03:15:43.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6152024-08-22T03:15:43.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6162024-08-22T03:15:43.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6172024-08-22T03:15:43.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.122789ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6182024-08-22T03:15:43.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192024-08-22T03:15:43.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
6202024-08-22T03:15:43.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6212024-08-22T03:15:43.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6222024-08-22T03:15:43.250ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
6232024-08-22T03:15:43.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.995302ms iteration = 21 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
6242024-08-22T03:15:43.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fcfba6f3-98cc-44c6-8e33-0ea0707be8ac roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6252024-08-22T03:15:43.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fcfba6f3-98cc-44c6-8e33-0ea0707be8ac resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6262024-08-22T03:15:43.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fcfba6f3-98cc-44c6-8e33-0ea0707be8ac response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6272024-08-22T03:15:44.439ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1414 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 4a529337-633d-40a3-a92e-4a1f63e93fc6 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
6282024-08-22T03:15:44.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 523ee2f3-e2d9-4b0d-8b49-d2bac3c806b3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6292024-08-22T03:15:44.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 523ee2f3-e2d9-4b0d-8b49-d2bac3c806b3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6302024-08-22T03:15:44.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 523ee2f3-e2d9-4b0d-8b49-d2bac3c806b3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6312024-08-22T03:15:45.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5094c695-e8a7-4c3c-ad6e-b5fb742ce8c2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6322024-08-22T03:15:45.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5094c695-e8a7-4c3c-ad6e-b5fb742ce8c2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6332024-08-22T03:15:45.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5094c695-e8a7-4c3c-ad6e-b5fb742ce8c2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6342024-08-22T03:15:46.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9e2808e4-1aae-493d-9232-878b8cb7c25e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6352024-08-22T03:15:46.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9e2808e4-1aae-493d-9232-878b8cb7c25e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6362024-08-22T03:15:46.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1869 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9e2808e4-1aae-493d-9232-878b8cb7c25e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6372024-08-22T03:15:47.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f154699-d73c-4fef-9686-91a9cb0363fd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6382024-08-22T03:15:47.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f154699-d73c-4fef-9686-91a9cb0363fd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6392024-08-22T03:15:47.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f154699-d73c-4fef-9686-91a9cb0363fd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6402024-08-22T03:15:48.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4611164a-169a-4754-aede-e170b6aee1d9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6412024-08-22T03:15:48.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4611164a-169a-4754-aede-e170b6aee1d9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6422024-08-22T03:15:48.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4611164a-169a-4754-aede-e170b6aee1d9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6432024-08-22T03:15:49.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7eb41a1-7639-45a6-bf93-9bc02f7f2fd8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6442024-08-22T03:15:49.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7eb41a1-7639-45a6-bf93-9bc02f7f2fd8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6452024-08-22T03:15:49.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7eb41a1-7639-45a6-bf93-9bc02f7f2fd8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6462024-08-22T03:15:50.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8af98aae-039a-4a85-9f3a-9977349b1c06 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6472024-08-22T03:15:50.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8af98aae-039a-4a85-9f3a-9977349b1c06 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6482024-08-22T03:15:50.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8af98aae-039a-4a85-9f3a-9977349b1c06 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6492024-08-22T03:15:51.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1f0ec460-7470-4da6-b6d7-d3ef3abf4a05 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6502024-08-22T03:15:51.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1f0ec460-7470-4da6-b6d7-d3ef3abf4a05 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6512024-08-22T03:15:51.873ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1f0ec460-7470-4da6-b6d7-d3ef3abf4a05 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6522024-08-22T03:15:52.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f2f4acb-c5cf-4801-bc5c-bdf0ca6082d3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6532024-08-22T03:15:52.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f2f4acb-c5cf-4801-bc5c-bdf0ca6082d3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6542024-08-22T03:15:52.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2517 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f2f4acb-c5cf-4801-bc5c-bdf0ca6082d3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
6552024-08-22T03:15:53.234ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
6562024-08-22T03:15:53.234ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
6572024-08-22T03:15:53.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6582024-08-22T03:15:53.234ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
6592024-08-22T03:15:53.234ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
6602024-08-22T03:15:53.234ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
6612024-08-22T03:15:53.234ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6622024-08-22T03:15:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6632024-08-22T03:15:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
6642024-08-22T03:15:53.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6652024-08-22T03:15:53.236ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
6662024-08-22T03:15:53.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6672024-08-22T03:15:53.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-08-22T03:15:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6692024-08-22T03:15:53.236ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.945635ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6702024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
6712024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
6722024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
6732024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6742024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
6752024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
6762024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
6772024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
6782024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6792024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
6802024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
6812024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6822024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6832024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
6842024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6852024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
6862024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
6872024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6882024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
6892024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
6902024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6912024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
6922024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
6932024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6942024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6952024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6962024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6972024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6982024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
6992024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7002024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7012024-08-22T03:15:53.237ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 761361088 } })
7022024-08-22T03:15:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7032024-08-22T03:15:53.238ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
7042024-08-22T03:15:53.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7052024-08-22T03:15:53.238ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.780182ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
7062024-08-22T03:15:53.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7072024-08-22T03:15:53.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7082024-08-22T03:15:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
7092024-08-22T03:15:53.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7102024-08-22T03:15:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7112024-08-22T03:15:53.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7122024-08-22T03:15:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7132024-08-22T03:15:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7142024-08-22T03:15:53.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7152024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7162024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7172024-08-22T03:15:53.241ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
7182024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7192024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7202024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7212024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7222024-08-22T03:15:53.241ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 764969733 } })
7232024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7242024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
7252024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
7262024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7272024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7282024-08-22T03:15:53.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
7292024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7302024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
7312024-08-22T03:15:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7322024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7332024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7342024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7352024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7362024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7372024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7382024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
7392024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7402024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7412024-08-22T03:15:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7422024-08-22T03:15:53.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.884954ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7432024-08-22T03:15:53.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7442024-08-22T03:15:53.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 767072110 } })
7452024-08-22T03:15:53.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.521671ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7462024-08-22T03:15:53.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7472024-08-22T03:15:53.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
7482024-08-22T03:15:53.244ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
7492024-08-22T03:15:53.244ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7502024-08-22T03:15:53.244ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 7.209681ms iteration = 8 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
7512024-08-22T03:15:53.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7522024-08-22T03:15:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7532024-08-22T03:15:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
7542024-08-22T03:15:53.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
7552024-08-22T03:15:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
7562024-08-22T03:15:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
7572024-08-22T03:15:53.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7582024-08-22T03:15:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7592024-08-22T03:15:53.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
7602024-08-22T03:15:53.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7612024-08-22T03:15:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7622024-08-22T03:15:53.248ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7632024-08-22T03:15:53.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.1371ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7642024-08-22T03:15:53.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7652024-08-22T03:15:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7662024-08-22T03:15:53.251ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
7672024-08-22T03:15:53.252ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.139906ms iteration = 22 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
7682024-08-22T03:15:53.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7692024-08-22T03:15:53.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7702024-08-22T03:15:53.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7712024-08-22T03:15:53.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7722024-08-22T03:15:53.259ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7732024-08-22T03:15:53.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7742024-08-22T03:15:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7752024-08-22T03:15:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7762024-08-22T03:15:53.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7772024-08-22T03:15:53.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7782024-08-22T03:15:53.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7792024-08-22T03:15:53.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7802024-08-22T03:15:53.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7812024-08-22T03:15:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7822024-08-22T03:15:53.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7832024-08-22T03:15:53.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
7842024-08-22T03:15:53.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7852024-08-22T03:15:53.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7862024-08-22T03:15:53.273ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 35.717919ms iteration = 8 status = 0
7872024-08-22T03:15:53.277ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7882024-08-22T03:15:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7892024-08-22T03:15:53.278ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 41.520272ms iteration = 8 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
7902024-08-22T03:15:53.285ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 49.116257ms iteration = 11 status = {"physical_disks_added":0}
7912024-08-22T03:15:53.371ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
7922024-08-22T03:15:53.371ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7932024-08-22T03:15:53.371ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "86c16f13-5476-48ba-b78a-a4e8430f6764", "content-length": "26", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
7942024-08-22T03:15:53.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7952024-08-22T03:15:53.373ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7962024-08-22T03:15:53.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
7972024-08-22T03:15:53.374ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7982024-08-22T03:15:53.375ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5cfaa065-0201-48f6-85b7-4fd4ccd055c0", "content-length": "26", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
7992024-08-22T03:15:53.375ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8002024-08-22T03:15:53.377ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
8012024-08-22T03:15:53.382ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
8022024-08-22T03:15:53.382ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8032024-08-22T03:15:53.383ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cbd15d49-0463-4e46-88fa-2618b1275a14", "content-length": "26", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
8042024-08-22T03:15:53.383ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8052024-08-22T03:15:53.385ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
8062024-08-22T03:15:53.505ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8072024-08-22T03:15:53.506ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2b433595-5015-4bb2-921b-25c0acb48188", "content-length": "372", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
8082024-08-22T03:15:53.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8092024-08-22T03:15:53.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8102024-08-22T03:15:53.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8112024-08-22T03:15:53.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8122024-08-22T03:15:53.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8132024-08-22T03:15:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8142024-08-22T03:15:53.512ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8152024-08-22T03:15:53.513ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3f02acb9-5987-4555-a5d9-9b3abec094a6", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
8162024-08-22T03:15:53.514ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.726332ms iteration = 9 status = {}
8172024-08-22T03:15:53.525ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8182024-08-22T03:15:53.525ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "59d80a70-dc6f-4231-8201-c8ad0ead2ee0", "content-length": "1", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
8192024-08-22T03:15:53.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8202024-08-22T03:15:53.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8212024-08-22T03:15:53.528ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 293.877464ms iteration = 8 status = null
8222024-08-22T03:15:53.531ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8232024-08-22T03:15:53.532ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "53bd821b-e2e0-4895-8138-9389777ce490", "content-length": "691", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
8242024-08-22T03:15:53.532ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
8252024-08-22T03:15:53.532ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
8262024-08-22T03:15:53.532ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
8272024-08-22T03:15:53.534ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 297.149956ms iteration = 8 status = {}
8282024-08-22T03:15:53.596ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 361.212641ms iteration = 8 status = {}
8292024-08-22T03:15:53.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 57e22693-d22d-434e-bcf2-427d693e2319 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
8302024-08-22T03:15:53.597ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 57e22693-d22d-434e-bcf2-427d693e2319 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
8312024-08-22T03:15:53.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 57e22693-d22d-434e-bcf2-427d693e2319 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
8322024-08-22T03:15:53.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8332024-08-22T03:15:53.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8342024-08-22T03:15:53.656ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
8352024-08-22T03:15:53.656ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8362024-08-22T03:15:53.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8372024-08-22T03:15:53.663ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8382024-08-22T03:15:53.663ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5ee77277-8c9d-41a3-a0eb-1337cf9600fd", "content-length": "121", "date": "Thu, 22 Aug 2024 03:15:53 GMT"} })
8392024-08-22T03:15:53.663ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
8402024-08-22T03:15:53.663ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
8412024-08-22T03:15:53.663ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8422024-08-22T03:15:53.663ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8432024-08-22T03:15:53.663ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
8442024-08-22T03:15:53.663ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
8452024-08-22T03:15:53.663ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
8462024-08-22T03:15:53.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8472024-08-22T03:15:53.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8482024-08-22T03:15:53.665ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
8492024-08-22T03:15:53.665ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5a93cff4-f938-4e78-aae8-e98cc0d5151f", "content-length": "2", "date": "Thu, 22 Aug 2024 03:15:53 GMT"} })
8502024-08-22T03:15:53.665ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
8512024-08-22T03:15:53.665ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "49a3ce64-939a-44e3-93be-1ff7ea0d9816", "content-length": "51", "date": "Thu, 22 Aug 2024 03:15:53 GMT"} })
8522024-08-22T03:15:53.665ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
8532024-08-22T03:15:53.665ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
8542024-08-22T03:15:53.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dc193a46-9958-4b34-904b-633f025fe87d", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
8552024-08-22T03:15:53.755ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
8562024-08-22T03:15:53.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
8572024-08-22T03:15:53.758ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "83ae2207-3848-43b3-8260-11104762d97c", "content-length": "667", "date": "Thu, 22 Aug 2024 03:15:52 GMT"} })
8582024-08-22T03:15:53.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8592024-08-22T03:15:53.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8602024-08-22T03:15:53.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8612024-08-22T03:15:53.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8622024-08-22T03:15:53.764ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8632024-08-22T03:15:53.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8642024-08-22T03:15:53.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8652024-08-22T03:15:53.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8662024-08-22T03:15:53.772ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 535.515852ms iteration = 8 status = {}
8672024-08-22T03:15:53.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f4c1c6fd-3d65-4701-b3c4-e420d3df997e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8682024-08-22T03:15:53.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f4c1c6fd-3d65-4701-b3c4-e420d3df997e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8692024-08-22T03:15:53.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f4c1c6fd-3d65-4701-b3c4-e420d3df997e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8702024-08-22T03:15:54.439ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1606 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = cb4ac483-343e-4740-8f58-3be5ad628f36 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
8712024-08-22T03:15:54.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61b22d49-3c73-497a-bb41-7f18536d706d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8722024-08-22T03:15:54.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61b22d49-3c73-497a-bb41-7f18536d706d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8732024-08-22T03:15:54.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61b22d49-3c73-497a-bb41-7f18536d706d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8742024-08-22T03:15:55.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82b6ec04-4904-4d38-be37-1cc7a891c5f2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8752024-08-22T03:15:55.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82b6ec04-4904-4d38-be37-1cc7a891c5f2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8762024-08-22T03:15:55.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82b6ec04-4904-4d38-be37-1cc7a891c5f2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8772024-08-22T03:15:57.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c504b7d5-c45e-41d4-b84a-0563c350c36a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8782024-08-22T03:15:57.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c504b7d5-c45e-41d4-b84a-0563c350c36a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8792024-08-22T03:15:57.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1839 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c504b7d5-c45e-41d4-b84a-0563c350c36a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8802024-08-22T03:15:58.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6ca5eeed-fdf2-4ad0-af1b-ffd89339a6f5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8812024-08-22T03:15:58.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6ca5eeed-fdf2-4ad0-af1b-ffd89339a6f5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8822024-08-22T03:15:58.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6ca5eeed-fdf2-4ad0-af1b-ffd89339a6f5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8832024-08-22T03:15:59.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 31995f26-1c67-472e-9a28-66095c88e3f0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8842024-08-22T03:15:59.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 31995f26-1c67-472e-9a28-66095c88e3f0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8852024-08-22T03:15:59.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 31995f26-1c67-472e-9a28-66095c88e3f0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8862024-08-22T03:16:00.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 95c2e6b1-716c-48b6-9546-520a30636bfd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8872024-08-22T03:16:00.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 95c2e6b1-716c-48b6-9546-520a30636bfd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8882024-08-22T03:16:00.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 95c2e6b1-716c-48b6-9546-520a30636bfd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8892024-08-22T03:16:01.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9278016-b5bf-4106-aefe-db44ba68a375 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8902024-08-22T03:16:01.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9278016-b5bf-4106-aefe-db44ba68a375 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8912024-08-22T03:16:01.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9278016-b5bf-4106-aefe-db44ba68a375 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8922024-08-22T03:16:02.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e47794c4-eebd-44ed-9866-90de706d7c6b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8932024-08-22T03:16:02.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e47794c4-eebd-44ed-9866-90de706d7c6b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8942024-08-22T03:16:02.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e47794c4-eebd-44ed-9866-90de706d7c6b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8952024-08-22T03:16:03.139ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a6d1d84d-cbd1-430e-8cf9-8ebec3926d3d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8962024-08-22T03:16:03.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a6d1d84d-cbd1-430e-8cf9-8ebec3926d3d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8972024-08-22T03:16:03.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a6d1d84d-cbd1-430e-8cf9-8ebec3926d3d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
8982024-08-22T03:16:03.234ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
8992024-08-22T03:16:03.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9002024-08-22T03:16:03.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9012024-08-22T03:16:03.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9022024-08-22T03:16:03.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
9032024-08-22T03:16:03.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9042024-08-22T03:16:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9052024-08-22T03:16:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9062024-08-22T03:16:03.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9072024-08-22T03:16:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9082024-08-22T03:16:03.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9092024-08-22T03:16:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9102024-08-22T03:16:03.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9112024-08-22T03:16:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9122024-08-22T03:16:03.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.088179ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9132024-08-22T03:16:03.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9142024-08-22T03:16:03.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
9152024-08-22T03:16:03.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9162024-08-22T03:16:03.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9172024-08-22T03:16:03.249ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
9182024-08-22T03:16:03.249ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.269259ms iteration = 23 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
9192024-08-22T03:16:04.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 64c82ac3-1760-4fcc-a4de-42772e15d2f0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9202024-08-22T03:16:04.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 64c82ac3-1760-4fcc-a4de-42772e15d2f0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9212024-08-22T03:16:04.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 64c82ac3-1760-4fcc-a4de-42772e15d2f0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9222024-08-22T03:16:04.440ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1467 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 72c7e639-7eaa-4bd2-98ee-d8ca89e1bf89 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
9232024-08-22T03:16:05.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cf2f9cfa-5bda-40a4-86fb-0eee19bcea5a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9242024-08-22T03:16:05.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cf2f9cfa-5bda-40a4-86fb-0eee19bcea5a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9252024-08-22T03:16:05.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cf2f9cfa-5bda-40a4-86fb-0eee19bcea5a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9262024-08-22T03:16:06.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 713a8069-114f-4697-b8ae-5fc2da6e7265 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9272024-08-22T03:16:06.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 713a8069-114f-4697-b8ae-5fc2da6e7265 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9282024-08-22T03:16:06.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 713a8069-114f-4697-b8ae-5fc2da6e7265 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9292024-08-22T03:16:07.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82293643-ef8a-423b-8fad-249ee2a55f47 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9302024-08-22T03:16:07.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82293643-ef8a-423b-8fad-249ee2a55f47 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9312024-08-22T03:16:07.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82293643-ef8a-423b-8fad-249ee2a55f47 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9322024-08-22T03:16:08.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7f8927e1-7f52-466b-b0c2-de8b2eede5b7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9332024-08-22T03:16:08.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7f8927e1-7f52-466b-b0c2-de8b2eede5b7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9342024-08-22T03:16:08.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7f8927e1-7f52-466b-b0c2-de8b2eede5b7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9352024-08-22T03:16:09.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a39be39f-4758-4179-8c27-e33ceae7e29c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9362024-08-22T03:16:09.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a39be39f-4758-4179-8c27-e33ceae7e29c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9372024-08-22T03:16:09.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a39be39f-4758-4179-8c27-e33ceae7e29c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9382024-08-22T03:16:10.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aa17562f-b7ce-4f4d-b6b3-11e36b8a586c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9392024-08-22T03:16:10.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aa17562f-b7ce-4f4d-b6b3-11e36b8a586c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9402024-08-22T03:16:10.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aa17562f-b7ce-4f4d-b6b3-11e36b8a586c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9412024-08-22T03:16:11.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 23a6e5c5-193a-4f49-bc98-f6b9a316f307 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9422024-08-22T03:16:11.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 23a6e5c5-193a-4f49-bc98-f6b9a316f307 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9432024-08-22T03:16:11.309ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 23a6e5c5-193a-4f49-bc98-f6b9a316f307 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9442024-08-22T03:16:12.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 499afd44-11dc-4e27-b4d0-d5375f6c6ae0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9452024-08-22T03:16:12.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 499afd44-11dc-4e27-b4d0-d5375f6c6ae0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9462024-08-22T03:16:12.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 499afd44-11dc-4e27-b4d0-d5375f6c6ae0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9472024-08-22T03:16:13.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
9482024-08-22T03:16:13.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9492024-08-22T03:16:13.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9502024-08-22T03:16:13.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9512024-08-22T03:16:13.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
9522024-08-22T03:16:13.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9532024-08-22T03:16:13.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9542024-08-22T03:16:13.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9552024-08-22T03:16:13.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9562024-08-22T03:16:13.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9572024-08-22T03:16:13.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9582024-08-22T03:16:13.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9592024-08-22T03:16:13.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.985418ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9602024-08-22T03:16:13.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9612024-08-22T03:16:13.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9622024-08-22T03:16:13.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9632024-08-22T03:16:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
9642024-08-22T03:16:13.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9652024-08-22T03:16:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9662024-08-22T03:16:13.249ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
9672024-08-22T03:16:13.249ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.417481ms iteration = 24 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
9682024-08-22T03:16:13.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f9f1ad0c-ddd4-455b-8023-726b28172610 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9692024-08-22T03:16:13.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f9f1ad0c-ddd4-455b-8023-726b28172610 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9702024-08-22T03:16:13.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f9f1ad0c-ddd4-455b-8023-726b28172610 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9712024-08-22T03:16:14.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ad0658ed-9138-4c77-aa76-18451912b471 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9722024-08-22T03:16:14.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ad0658ed-9138-4c77-aa76-18451912b471 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9732024-08-22T03:16:14.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ad0658ed-9138-4c77-aa76-18451912b471 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9742024-08-22T03:16:14.440ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1489 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 55688b58-ea91-4589-b920-f0f616cc8024 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
9752024-08-22T03:16:15.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 423914fe-2f59-4007-bbdb-aa2dbbc0af34 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9762024-08-22T03:16:15.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 423914fe-2f59-4007-bbdb-aa2dbbc0af34 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9772024-08-22T03:16:15.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 423914fe-2f59-4007-bbdb-aa2dbbc0af34 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9782024-08-22T03:16:16.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d11ffbb7-4426-41ea-a183-ddda1b338c09 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9792024-08-22T03:16:16.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d11ffbb7-4426-41ea-a183-ddda1b338c09 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9802024-08-22T03:16:16.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d11ffbb7-4426-41ea-a183-ddda1b338c09 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9812024-08-22T03:16:17.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 999c929d-459c-4918-b026-a7875cae66e0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9822024-08-22T03:16:17.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 999c929d-459c-4918-b026-a7875cae66e0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9832024-08-22T03:16:17.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 999c929d-459c-4918-b026-a7875cae66e0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9842024-08-22T03:16:18.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 118f0410-e061-41ba-8374-5a8dfe082684 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9852024-08-22T03:16:18.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 118f0410-e061-41ba-8374-5a8dfe082684 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9862024-08-22T03:16:18.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 118f0410-e061-41ba-8374-5a8dfe082684 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9872024-08-22T03:16:19.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1c633c20-54bd-4fba-a07c-a93c18f47863 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9882024-08-22T03:16:19.477ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1c633c20-54bd-4fba-a07c-a93c18f47863 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9892024-08-22T03:16:19.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1c633c20-54bd-4fba-a07c-a93c18f47863 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9902024-08-22T03:16:20.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6f2da6c4-2142-4349-9c6d-5ca211086d92 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9912024-08-22T03:16:20.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6f2da6c4-2142-4349-9c6d-5ca211086d92 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9922024-08-22T03:16:20.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6f2da6c4-2142-4349-9c6d-5ca211086d92 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9932024-08-22T03:16:21.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 755430e0-b6b4-4b66-99c4-f1ae1790ad93 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9942024-08-22T03:16:21.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 755430e0-b6b4-4b66-99c4-f1ae1790ad93 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9952024-08-22T03:16:21.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 755430e0-b6b4-4b66-99c4-f1ae1790ad93 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9962024-08-22T03:16:22.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 81325e6c-5547-4c7c-a186-6d29b8c7822d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9972024-08-22T03:16:22.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 81325e6c-5547-4c7c-a186-6d29b8c7822d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9982024-08-22T03:16:22.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 7554 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 81325e6c-5547-4c7c-a186-6d29b8c7822d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
9992024-08-22T03:16:23.234ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
10002024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
10012024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
10022024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
10032024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
10042024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
10052024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10062024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
10072024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10082024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10092024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
10102024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10112024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
10122024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
10132024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
10142024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
10152024-08-22T03:16:23.235ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = bff907f0-2101-418e-8f5d-955661c8bd6f
10162024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.85\u{b5}s iteration = 6 status = {"error":"blueprint disabled","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f"}
10172024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
10182024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
10192024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
10202024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
10212024-08-22T03:16:23.235ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-22 03:06:23.235138715 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
10222024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10232024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
10242024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10252024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10262024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10272024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
10282024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10292024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
10302024-08-22T03:16:23.235ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1467044e-2fe8-4015-be86-a3faa36f1469.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64fff417-46fd-44ed-ac7e-a3829d9efa54.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 758537772 } })
10312024-08-22T03:16:23.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10322024-08-22T03:16:23.235ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3ce7517f-82f9-4849-ad08-7cb0bf67f024.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 758643974 } })
10332024-08-22T03:16:23.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
10342024-08-22T03:16:23.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
10352024-08-22T03:16:23.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10362024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
10372024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10382024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10392024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
10402024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.708634ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
10412024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
10422024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
10432024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10442024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
10452024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
10462024-08-22T03:16:23.237ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
10472024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 2.683523ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
10482024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
10492024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
10502024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
10512024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10522024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10532024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
10542024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
10552024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
10562024-08-22T03:16:23.237ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
10572024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
10582024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
10592024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10602024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
10612024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10622024-08-22T03:16:23.237ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10632024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
10642024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10652024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
10662024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
10672024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10682024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10692024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
10702024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10712024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
10722024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10732024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10742024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.022818ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10752024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10762024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
10772024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
10782024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
10792024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
10802024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10812024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10822024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10832024-08-22T03:16:23.238ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-22 03:06:23.235138715 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
10842024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10852024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.259961ms iteration = 5 status = {"expiration":"2024-08-22T03:06:23.235138715Z","pruned":[]}
10862024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10872024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10882024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10892024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10902024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10912024-08-22T03:16:23.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922024-08-22T03:16:23.238ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 761861224 } })
10932024-08-22T03:16:23.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 762026886 } })
10942024-08-22T03:16:23.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10952024-08-22T03:16:23.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10962024-08-22T03:16:23.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
10972024-08-22T03:16:23.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10982024-08-22T03:16:23.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10992024-08-22T03:16:23.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11002024-08-22T03:16:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11012024-08-22T03:16:23.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11022024-08-22T03:16:23.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11032024-08-22T03:16:23.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
11042024-08-22T03:16:23.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.882868ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11052024-08-22T03:16:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11062024-08-22T03:16:23.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11072024-08-22T03:16:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11082024-08-22T03:16:23.242ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.501546ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
11092024-08-22T03:16:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11102024-08-22T03:16:23.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11112024-08-22T03:16:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11122024-08-22T03:16:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11132024-08-22T03:16:23.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
11142024-08-22T03:16:23.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11152024-08-22T03:16:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11162024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11172024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
11182024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11192024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
11202024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
11212024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
11222024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11232024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
11242024-08-22T03:16:23.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11252024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11262024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11272024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11282024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11292024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
11302024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11312024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11322024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11332024-08-22T03:16:23.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11342024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11352024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11362024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11372024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11382024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
11392024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
11402024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
11412024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11422024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11432024-08-22T03:16:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11442024-08-22T03:16:23.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11452024-08-22T03:16:23.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11462024-08-22T03:16:23.248ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
11472024-08-22T03:16:23.248ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11482024-08-22T03:16:23.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11492024-08-22T03:16:23.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11502024-08-22T03:16:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11512024-08-22T03:16:23.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11522024-08-22T03:16:23.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 771812499 } })
11532024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11542024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.303702ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
11552024-08-22T03:16:23.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
11562024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11572024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11582024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11592024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11602024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11612024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11622024-08-22T03:16:23.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11632024-08-22T03:16:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11642024-08-22T03:16:23.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11652024-08-22T03:16:23.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11662024-08-22T03:16:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.551068ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11672024-08-22T03:16:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11682024-08-22T03:16:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11692024-08-22T03:16:23.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11702024-08-22T03:16:23.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11712024-08-22T03:16:23.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722024-08-22T03:16:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
11732024-08-22T03:16:23.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11742024-08-22T03:16:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11752024-08-22T03:16:23.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.635644ms iteration = 9 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
11762024-08-22T03:16:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
11772024-08-22T03:16:23.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11782024-08-22T03:16:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11792024-08-22T03:16:23.253ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
11802024-08-22T03:16:23.253ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
11812024-08-22T03:16:23.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
11822024-08-22T03:16:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
11832024-08-22T03:16:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
11842024-08-22T03:16:23.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11852024-08-22T03:16:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11862024-08-22T03:16:23.254ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11872024-08-22T03:16:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11882024-08-22T03:16:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11892024-08-22T03:16:23.254ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
11902024-08-22T03:16:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
11912024-08-22T03:16:23.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11922024-08-22T03:16:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
11932024-08-22T03:16:23.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
11942024-08-22T03:16:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
11952024-08-22T03:16:23.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11962024-08-22T03:16:23.256ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11972024-08-22T03:16:23.256ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.234509ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11982024-08-22T03:16:23.257ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
11992024-08-22T03:16:23.257ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 0 version = 2
12002024-08-22T03:16:23.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12012024-08-22T03:16:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12022024-08-22T03:16:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
12032024-08-22T03:16:23.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
12042024-08-22T03:16:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
12052024-08-22T03:16:23.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12062024-08-22T03:16:23.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
12072024-08-22T03:16:23.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
12082024-08-22T03:16:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
12092024-08-22T03:16:23.261ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
12102024-08-22T03:16:23.261ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
12112024-08-22T03:16:23.261ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-22 03:13:02.692706 UTC dns_group = internal generation = 1
12122024-08-22T03:16:23.261ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 26.079508ms iteration = 6 status = {"generation":1}
12132024-08-22T03:16:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
12142024-08-22T03:16:23.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
12152024-08-22T03:16:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
12162024-08-22T03:16:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 26.20843ms iteration = 12 status = {"physical_disks_added":0}
12172024-08-22T03:16:23.265ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 1 version = 2
12182024-08-22T03:16:23.265ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
12192024-08-22T03:16:23.265ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-22 03:13:03.125979 UTC dns_group = external generation = 2
12202024-08-22T03:16:23.265ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 29.870835ms iteration = 6 status = {"generation":2}
12212024-08-22T03:16:23.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12222024-08-22T03:16:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12232024-08-22T03:16:23.267ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
12242024-08-22T03:16:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 32.514349ms iteration = 25 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
12252024-08-22T03:16:23.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12262024-08-22T03:16:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12272024-08-22T03:16:23.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12282024-08-22T03:16:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12292024-08-22T03:16:23.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12302024-08-22T03:16:23.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12312024-08-22T03:16:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12322024-08-22T03:16:23.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12332024-08-22T03:16:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
12342024-08-22T03:16:23.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12352024-08-22T03:16:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12362024-08-22T03:16:23.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12372024-08-22T03:16:23.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12382024-08-22T03:16:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12392024-08-22T03:16:23.276ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 38.409003ms iteration = 9 status = 0
12402024-08-22T03:16:23.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412024-08-22T03:16:23.277ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
12422024-08-22T03:16:23.277ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
12432024-08-22T03:16:23.277ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 39.523597ms iteration = 5 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
12442024-08-22T03:16:23.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12452024-08-22T03:16:23.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12462024-08-22T03:16:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12472024-08-22T03:16:23.278ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
12482024-08-22T03:16:23.278ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12492024-08-22T03:16:23.278ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 40.703152ms iteration = 9 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
12502024-08-22T03:16:23.282ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
12512024-08-22T03:16:23.282ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
12522024-08-22T03:16:23.282ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 44.242276ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
12532024-08-22T03:16:23.304ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-22T03:12:22.052278Z, time_modified: 2024-08-22T03:12:22.052278Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }) }
12542024-08-22T03:16:23.304ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 69.108908ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]}},"default_endpoint":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
12552024-08-22T03:16:23.407ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
12562024-08-22T03:16:23.414ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
12572024-08-22T03:16:23.446ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
12582024-08-22T03:16:23.446ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12592024-08-22T03:16:23.447ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "67f118b5-a56d-4057-8ef5-055ff723ed1c", "content-length": "26", "date": "Thu, 22 Aug 2024 03:16:22 GMT"} })
12602024-08-22T03:16:23.447ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12612024-08-22T03:16:23.448ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12622024-08-22T03:16:23.459ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
12632024-08-22T03:16:23.459ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12642024-08-22T03:16:23.460ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4195273a-8c71-48e2-99d5-e4a4378b3a61", "content-length": "26", "date": "Thu, 22 Aug 2024 03:16:22 GMT"} })
12652024-08-22T03:16:23.460ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12662024-08-22T03:16:23.461ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
12672024-08-22T03:16:23.470ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12682024-08-22T03:16:23.470ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b0e577a2-880a-4429-ba4d-3532c540dfb8", "content-length": "372", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} })
12692024-08-22T03:16:23.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12702024-08-22T03:16:23.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12712024-08-22T03:16:23.472ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12722024-08-22T03:16:23.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12732024-08-22T03:16:23.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12742024-08-22T03:16:23.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12752024-08-22T03:16:23.477ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12762024-08-22T03:16:23.477ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "016252ec-88f7-47fb-b91e-38d2196c2c96", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} })
12772024-08-22T03:16:23.479ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 241.79556ms iteration = 10 status = {}
12782024-08-22T03:16:23.539ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
12792024-08-22T03:16:23.539ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12802024-08-22T03:16:23.539ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d543f278-634f-4aec-8474-0e792662e6d8", "content-length": "26", "date": "Thu, 22 Aug 2024 03:16:22 GMT"} })
12812024-08-22T03:16:23.539ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12822024-08-22T03:16:23.541ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12832024-08-22T03:16:23.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b7ac4ed-388f-441d-9345-9de5c357663d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
12842024-08-22T03:16:23.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b7ac4ed-388f-441d-9345-9de5c357663d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
12852024-08-22T03:16:23.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1730 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b7ac4ed-388f-441d-9345-9de5c357663d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
12862024-08-22T03:16:23.588ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12872024-08-22T03:16:23.588ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
12882024-08-22T03:16:23.589ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "682dbe1d-8fed-4cc5-8af4-975d40c411f0", "content-length": "691", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} })
12892024-08-22T03:16:23.589ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
12902024-08-22T03:16:23.589ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
12912024-08-22T03:16:23.589ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
12922024-08-22T03:16:23.591ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 353.380823ms iteration = 9 status = {}
12932024-08-22T03:16:23.609ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12942024-08-22T03:16:23.609ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2bbc662f-577b-42ae-a270-37c480b52357", "content-length": "1", "date": "Thu, 22 Aug 2024 03:16:22 GMT"} })
12952024-08-22T03:16:23.611ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12962024-08-22T03:16:23.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12972024-08-22T03:16:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 377.81724ms iteration = 9 status = null
12982024-08-22T03:16:23.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 579a45cd-73cc-4b18-8e3a-34c2e3a7f677 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
12992024-08-22T03:16:23.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 579a45cd-73cc-4b18-8e3a-34c2e3a7f677 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
13002024-08-22T03:16:23.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 579a45cd-73cc-4b18-8e3a-34c2e3a7f677 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
13012024-08-22T03:16:23.679ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 444.318646ms iteration = 9 status = {}
13022024-08-22T03:16:23.689ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
13032024-08-22T03:16:23.689ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "461dd6f3-1ae6-4803-82da-419d604f842d", "date": "Thu, 22 Aug 2024 03:16:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13042024-08-22T03:16:23.689ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13052024-08-22T03:16:23.691ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "15966b10-29e1-4a9d-ab8a-c9a766e53590", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13062024-08-22T03:16:23.691ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13072024-08-22T03:16:23.693ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
13082024-08-22T03:16:23.693ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 458.417833ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
13092024-08-22T03:16:23.695ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
13102024-08-22T03:16:23.695ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f05cc976-84ca-48e1-8c0e-7e98e67a6c89", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13112024-08-22T03:16:23.695ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13122024-08-22T03:16:23.697ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a605b95a-270b-40dd-b01f-5af57c9ac6ca", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13132024-08-22T03:16:23.697ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13142024-08-22T03:16:23.699ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e95fc902-afb1-4045-a51f-cd2ee4ab0add", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13152024-08-22T03:16:23.699ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13162024-08-22T03:16:23.701ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
13172024-08-22T03:16:23.701ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 466.497315ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
13182024-08-22T03:16:23.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13192024-08-22T03:16:23.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13202024-08-22T03:16:23.761ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
13212024-08-22T03:16:23.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13222024-08-22T03:16:23.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13232024-08-22T03:16:23.770ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
13242024-08-22T03:16:23.771ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e9b2ffb-97ac-45a9-bd21-f0b4d5a0db04", "content-length": "121", "date": "Thu, 22 Aug 2024 03:16:22 GMT"} })
13252024-08-22T03:16:23.771ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
13262024-08-22T03:16:23.771ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
13272024-08-22T03:16:23.771ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13282024-08-22T03:16:23.771ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
13292024-08-22T03:16:23.771ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
13302024-08-22T03:16:23.771ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
13312024-08-22T03:16:23.771ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
13322024-08-22T03:16:23.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13332024-08-22T03:16:23.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13342024-08-22T03:16:23.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
13352024-08-22T03:16:23.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c08ace73-a54a-48a2-86ad-66dd3ea03082", "content-length": "2", "date": "Thu, 22 Aug 2024 03:16:22 GMT"} })
13362024-08-22T03:16:23.773ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13372024-08-22T03:16:23.773ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2032a140-cde0-4642-933d-39a20c7bec6b", "content-length": "51", "date": "Thu, 22 Aug 2024 03:16:22 GMT"} })
13382024-08-22T03:16:23.773ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
13392024-08-22T03:16:23.773ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13402024-08-22T03:16:23.863ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9028e06d-2413-4932-b166-e9a8d8f8c1a8", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} })
13412024-08-22T03:16:23.863ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
13422024-08-22T03:16:23.863ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13432024-08-22T03:16:23.864ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "821683b6-53b0-4d54-91c5-45c0f850bdec", "content-length": "667", "date": "Thu, 22 Aug 2024 03:16:23 GMT"} })
13442024-08-22T03:16:23.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13452024-08-22T03:16:23.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13462024-08-22T03:16:23.867ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13472024-08-22T03:16:23.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13482024-08-22T03:16:23.870ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13492024-08-22T03:16:23.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13502024-08-22T03:16:23.871ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13512024-08-22T03:16:23.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13522024-08-22T03:16:23.879ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 641.468524ms iteration = 9 status = {}
13532024-08-22T03:16:24.440ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1541 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 8f1e49d6-94da-4f74-bf02-1f0af3217518 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
13542024-08-22T03:16:24.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 412b9d21-148f-4cb4-b42d-927755beb0ae roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13552024-08-22T03:16:24.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 412b9d21-148f-4cb4-b42d-927755beb0ae resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13562024-08-22T03:16:24.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 412b9d21-148f-4cb4-b42d-927755beb0ae response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13572024-08-22T03:16:25.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 62a7559b-9690-4938-9f7d-b72a6664383c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13582024-08-22T03:16:25.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 62a7559b-9690-4938-9f7d-b72a6664383c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13592024-08-22T03:16:25.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2533 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 62a7559b-9690-4938-9f7d-b72a6664383c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13602024-08-22T03:16:26.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2da59c06-bb6b-4892-95a8-fdfc2b87e2d9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13612024-08-22T03:16:26.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2da59c06-bb6b-4892-95a8-fdfc2b87e2d9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13622024-08-22T03:16:26.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2da59c06-bb6b-4892-95a8-fdfc2b87e2d9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13632024-08-22T03:16:27.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7206579d-9647-40b7-8ab6-bf1993e72f7a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13642024-08-22T03:16:27.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7206579d-9647-40b7-8ab6-bf1993e72f7a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13652024-08-22T03:16:27.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7206579d-9647-40b7-8ab6-bf1993e72f7a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13662024-08-22T03:16:28.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f9cdf4e1-04e7-471a-bf7d-ff649354b897 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13672024-08-22T03:16:28.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f9cdf4e1-04e7-471a-bf7d-ff649354b897 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13682024-08-22T03:16:28.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f9cdf4e1-04e7-471a-bf7d-ff649354b897 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13692024-08-22T03:16:29.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cada95b0-4363-4fe7-9217-63c61c9e26ec roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13702024-08-22T03:16:29.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cada95b0-4363-4fe7-9217-63c61c9e26ec resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13712024-08-22T03:16:29.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cada95b0-4363-4fe7-9217-63c61c9e26ec response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13722024-08-22T03:16:30.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 75f77a51-0b84-4dfd-b630-c012ccf69bb9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13732024-08-22T03:16:30.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 75f77a51-0b84-4dfd-b630-c012ccf69bb9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13742024-08-22T03:16:30.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 75f77a51-0b84-4dfd-b630-c012ccf69bb9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13752024-08-22T03:16:31.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 493e09f5-424d-4e71-a766-bf0b75d8afe4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13762024-08-22T03:16:31.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 493e09f5-424d-4e71-a766-bf0b75d8afe4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13772024-08-22T03:16:31.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 493e09f5-424d-4e71-a766-bf0b75d8afe4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13782024-08-22T03:16:32.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e6342d0-9f01-43a4-bfca-50362c563463 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13792024-08-22T03:16:32.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e6342d0-9f01-43a4-bfca-50362c563463 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13802024-08-22T03:16:32.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2561 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e6342d0-9f01-43a4-bfca-50362c563463 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
13812024-08-22T03:16:33.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
13822024-08-22T03:16:33.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13832024-08-22T03:16:33.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13842024-08-22T03:16:33.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13852024-08-22T03:16:33.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
13862024-08-22T03:16:33.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13872024-08-22T03:16:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13882024-08-22T03:16:33.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13892024-08-22T03:16:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13902024-08-22T03:16:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13912024-08-22T03:16:33.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13922024-08-22T03:16:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13932024-08-22T03:16:33.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13942024-08-22T03:16:33.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13952024-08-22T03:16:33.241ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.895757ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13962024-08-22T03:16:33.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13972024-08-22T03:16:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
13982024-08-22T03:16:33.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13992024-08-22T03:16:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14002024-08-22T03:16:33.250ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
14012024-08-22T03:16:33.250ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.19096ms iteration = 26 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
14022024-08-22T03:16:33.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b87db2af-44c3-4066-bbf2-5587334c24de roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14032024-08-22T03:16:33.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b87db2af-44c3-4066-bbf2-5587334c24de resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14042024-08-22T03:16:33.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b87db2af-44c3-4066-bbf2-5587334c24de response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14052024-08-22T03:16:34.440ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1477 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 35abee85-39b7-4b7a-a1ca-cd9d266f4a68 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
14062024-08-22T03:16:34.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61e2ced3-3388-4204-b5fd-74f7baa0751d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14072024-08-22T03:16:34.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61e2ced3-3388-4204-b5fd-74f7baa0751d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14082024-08-22T03:16:34.807ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61e2ced3-3388-4204-b5fd-74f7baa0751d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14092024-08-22T03:16:35.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 05f11795-4e4c-41e0-ad23-35b7f62ec2fa roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14102024-08-22T03:16:35.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 05f11795-4e4c-41e0-ad23-35b7f62ec2fa resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14112024-08-22T03:16:35.829ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 05f11795-4e4c-41e0-ad23-35b7f62ec2fa response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14122024-08-22T03:16:36.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 86bfafd9-519e-4d80-9597-0780d23d472b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14132024-08-22T03:16:36.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 86bfafd9-519e-4d80-9597-0780d23d472b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14142024-08-22T03:16:36.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 86bfafd9-519e-4d80-9597-0780d23d472b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14152024-08-22T03:16:37.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c2f8d55e-be58-4e73-b39b-e9a958a6fd67 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14162024-08-22T03:16:37.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c2f8d55e-be58-4e73-b39b-e9a958a6fd67 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14172024-08-22T03:16:37.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c2f8d55e-be58-4e73-b39b-e9a958a6fd67 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14182024-08-22T03:16:38.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ebea2fb8-d7e2-4dff-8d64-90abe16930a3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14192024-08-22T03:16:38.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ebea2fb8-d7e2-4dff-8d64-90abe16930a3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14202024-08-22T03:16:38.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2308 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ebea2fb8-d7e2-4dff-8d64-90abe16930a3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14212024-08-22T03:16:39.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 323b6832-a8b6-4bd2-81b0-9586e904472f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14222024-08-22T03:16:39.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 323b6832-a8b6-4bd2-81b0-9586e904472f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14232024-08-22T03:16:39.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2470 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 323b6832-a8b6-4bd2-81b0-9586e904472f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14242024-08-22T03:16:40.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 046640b2-0224-41d3-a146-748bb9abf133 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14252024-08-22T03:16:40.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 046640b2-0224-41d3-a146-748bb9abf133 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14262024-08-22T03:16:40.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 046640b2-0224-41d3-a146-748bb9abf133 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14272024-08-22T03:16:41.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 12299859-5dd0-4bbf-887b-71cc97f4c1e6 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14282024-08-22T03:16:41.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 12299859-5dd0-4bbf-887b-71cc97f4c1e6 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14292024-08-22T03:16:41.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 12299859-5dd0-4bbf-887b-71cc97f4c1e6 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14302024-08-22T03:16:42.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 15311a9b-0a36-4e1a-a93b-949943c2b942 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14312024-08-22T03:16:42.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 15311a9b-0a36-4e1a-a93b-949943c2b942 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14322024-08-22T03:16:42.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 15311a9b-0a36-4e1a-a93b-949943c2b942 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14332024-08-22T03:16:43.235ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
14342024-08-22T03:16:43.235ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14352024-08-22T03:16:43.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14362024-08-22T03:16:43.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14372024-08-22T03:16:43.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
14382024-08-22T03:16:43.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14392024-08-22T03:16:43.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14402024-08-22T03:16:43.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14412024-08-22T03:16:43.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14422024-08-22T03:16:43.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14432024-08-22T03:16:43.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14442024-08-22T03:16:43.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14452024-08-22T03:16:43.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14462024-08-22T03:16:43.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14472024-08-22T03:16:43.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14482024-08-22T03:16:43.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.504374ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14492024-08-22T03:16:43.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
14502024-08-22T03:16:43.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14512024-08-22T03:16:43.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14522024-08-22T03:16:43.252ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
14532024-08-22T03:16:43.252ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.150936ms iteration = 27 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
14542024-08-22T03:16:43.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73f9e682-d866-4a0c-844a-2c29d422e14e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14552024-08-22T03:16:43.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73f9e682-d866-4a0c-844a-2c29d422e14e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14562024-08-22T03:16:43.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73f9e682-d866-4a0c-844a-2c29d422e14e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14572024-08-22T03:16:44.441ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1694 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 8c1a8bf8-0f81-49c2-8892-b21f93f9065d response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
14582024-08-22T03:16:45.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a9abb18b-727c-4a6b-8c80-bc203439fbfc roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14592024-08-22T03:16:45.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a9abb18b-727c-4a6b-8c80-bc203439fbfc resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14602024-08-22T03:16:45.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a9abb18b-727c-4a6b-8c80-bc203439fbfc response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14612024-08-22T03:16:46.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d247c577-1d98-4e1b-afba-6e9622a760c0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14622024-08-22T03:16:46.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d247c577-1d98-4e1b-afba-6e9622a760c0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14632024-08-22T03:16:46.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d247c577-1d98-4e1b-afba-6e9622a760c0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14642024-08-22T03:16:47.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c106ed16-10bf-4e54-a70f-cfeb389ca526 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14652024-08-22T03:16:47.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c106ed16-10bf-4e54-a70f-cfeb389ca526 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14662024-08-22T03:16:47.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c106ed16-10bf-4e54-a70f-cfeb389ca526 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14672024-08-22T03:16:48.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3ac62011-f5b3-43a2-98e2-c404a1296b5b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14682024-08-22T03:16:48.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3ac62011-f5b3-43a2-98e2-c404a1296b5b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14692024-08-22T03:16:48.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2452 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3ac62011-f5b3-43a2-98e2-c404a1296b5b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14702024-08-22T03:16:49.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 366935ef-0388-481f-98cf-88364579710b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14712024-08-22T03:16:49.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 366935ef-0388-481f-98cf-88364579710b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14722024-08-22T03:16:49.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 366935ef-0388-481f-98cf-88364579710b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14732024-08-22T03:16:50.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = abcee2c9-fba0-404b-a92d-aa1ebc2b6801 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14742024-08-22T03:16:50.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = abcee2c9-fba0-404b-a92d-aa1ebc2b6801 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14752024-08-22T03:16:50.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = abcee2c9-fba0-404b-a92d-aa1ebc2b6801 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14762024-08-22T03:16:51.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 980d5865-0245-433a-8adb-95496a4b8443 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14772024-08-22T03:16:51.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 980d5865-0245-433a-8adb-95496a4b8443 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14782024-08-22T03:16:51.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2509 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 980d5865-0245-433a-8adb-95496a4b8443 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14792024-08-22T03:16:52.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 75f83bec-c59c-4922-9ae6-e47705fa90ed roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14802024-08-22T03:16:52.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 75f83bec-c59c-4922-9ae6-e47705fa90ed resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14812024-08-22T03:16:52.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2476 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 75f83bec-c59c-4922-9ae6-e47705fa90ed response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14822024-08-22T03:16:53.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9edc67d1-f438-4f84-9210-3d7c78cc1804 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14832024-08-22T03:16:53.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9edc67d1-f438-4f84-9210-3d7c78cc1804 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14842024-08-22T03:16:53.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9edc67d1-f438-4f84-9210-3d7c78cc1804 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
14852024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
14862024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
14872024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
14882024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14892024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14902024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
14912024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
14922024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14932024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14942024-08-22T03:16:53.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14952024-08-22T03:16:53.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
14972024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14982024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
14992024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
15002024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15012024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15022024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
15032024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
15042024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15052024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
15062024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
15072024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
15082024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15092024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
15102024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15112024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15122024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
15132024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15142024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
15152024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
15162024-08-22T03:16:53.238ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15172024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
15182024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15192024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15202024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.596172ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15212024-08-22T03:16:53.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 761045090 } })
15222024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15232024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15242024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15252024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15262024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15272024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15282024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15292024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15302024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15312024-08-22T03:16:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15322024-08-22T03:16:53.239ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
15332024-08-22T03:16:53.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 761986012 } })
15342024-08-22T03:16:53.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15352024-08-22T03:16:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15362024-08-22T03:16:53.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15372024-08-22T03:16:53.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15382024-08-22T03:16:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15392024-08-22T03:16:53.240ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
15402024-08-22T03:16:53.240ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.938694ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
15412024-08-22T03:16:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15422024-08-22T03:16:53.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15432024-08-22T03:16:53.242ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
15442024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15452024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15462024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15472024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15482024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15492024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.364232ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15502024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15512024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15522024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15532024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15542024-08-22T03:16:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15552024-08-22T03:16:53.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15562024-08-22T03:16:53.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15572024-08-22T03:16:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15582024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15592024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15602024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15612024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15622024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15632024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15642024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15652024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15662024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15672024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15682024-08-22T03:16:53.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15692024-08-22T03:16:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15702024-08-22T03:16:53.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15712024-08-22T03:16:53.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15722024-08-22T03:16:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15732024-08-22T03:16:53.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15742024-08-22T03:16:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15752024-08-22T03:16:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
15762024-08-22T03:16:53.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15772024-08-22T03:16:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15782024-08-22T03:16:53.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
15792024-08-22T03:16:53.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15802024-08-22T03:16:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15812024-08-22T03:16:53.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15822024-08-22T03:16:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15832024-08-22T03:16:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15842024-08-22T03:16:53.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 771151037 } })
15852024-08-22T03:16:53.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 10.29575ms iteration = 10 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
15862024-08-22T03:16:53.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
15872024-08-22T03:16:53.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15882024-08-22T03:16:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15892024-08-22T03:16:53.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15902024-08-22T03:16:53.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15912024-08-22T03:16:53.260ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15922024-08-22T03:16:53.260ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.911606ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15932024-08-22T03:16:53.263ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 25.368539ms iteration = 13 status = {"physical_disks_added":0}
15942024-08-22T03:16:53.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
15952024-08-22T03:16:53.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.790332ms iteration = 28 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
15962024-08-22T03:16:53.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15972024-08-22T03:16:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15982024-08-22T03:16:53.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15992024-08-22T03:16:53.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16002024-08-22T03:16:53.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16012024-08-22T03:16:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16022024-08-22T03:16:53.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16032024-08-22T03:16:53.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16042024-08-22T03:16:53.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16052024-08-22T03:16:53.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
16062024-08-22T03:16:53.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16072024-08-22T03:16:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16082024-08-22T03:16:53.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16092024-08-22T03:16:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16102024-08-22T03:16:53.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16112024-08-22T03:16:53.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
16122024-08-22T03:16:53.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16132024-08-22T03:16:53.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16142024-08-22T03:16:53.277ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 38.377302ms iteration = 10 status = 0
16152024-08-22T03:16:53.277ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16162024-08-22T03:16:53.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16172024-08-22T03:16:53.279ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 40.324157ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16182024-08-22T03:16:53.282ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
16192024-08-22T03:16:53.282ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16202024-08-22T03:16:53.282ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 44.046004ms iteration = 10 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
16212024-08-22T03:16:53.359ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
16222024-08-22T03:16:53.359ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16232024-08-22T03:16:53.359ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f76273d4-c2e1-4da7-ac48-509a9c78fc8a", "content-length": "26", "date": "Thu, 22 Aug 2024 03:16:52 GMT"} })
16242024-08-22T03:16:53.359ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16252024-08-22T03:16:53.360ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16262024-08-22T03:16:53.364ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
16272024-08-22T03:16:53.364ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16282024-08-22T03:16:53.365ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fe65b449-64d9-4fd6-b080-52610e44acd7", "content-length": "26", "date": "Thu, 22 Aug 2024 03:16:52 GMT"} })
16292024-08-22T03:16:53.365ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16302024-08-22T03:16:53.367ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16312024-08-22T03:16:53.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
16322024-08-22T03:16:53.386ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16332024-08-22T03:16:53.387ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "99e6f92e-c676-44e9-a76f-4594aa853865", "content-length": "26", "date": "Thu, 22 Aug 2024 03:16:52 GMT"} })
16342024-08-22T03:16:53.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16352024-08-22T03:16:53.388ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
16362024-08-22T03:16:53.490ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 254.4957ms iteration = 10 status = {}
16372024-08-22T03:16:53.497ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
16382024-08-22T03:16:53.497ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "40598bc0-d66a-45b7-bbd8-41bddc857b80", "content-length": "1", "date": "Thu, 22 Aug 2024 03:16:53 GMT"} })
16392024-08-22T03:16:53.498ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16402024-08-22T03:16:53.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16412024-08-22T03:16:53.499ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16422024-08-22T03:16:53.499ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9062e828-c2bc-41c9-a2bc-71fab0f8e9f5", "content-length": "372", "date": "Thu, 22 Aug 2024 03:16:52 GMT"} })
16432024-08-22T03:16:53.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16442024-08-22T03:16:53.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16452024-08-22T03:16:53.500ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 264.354513ms iteration = 10 status = null
16462024-08-22T03:16:53.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16472024-08-22T03:16:53.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16482024-08-22T03:16:53.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16492024-08-22T03:16:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16502024-08-22T03:16:53.505ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16512024-08-22T03:16:53.506ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e62968fd-0fae-40dd-b657-beef7fd08ec4", "date": "Thu, 22 Aug 2024 03:16:52 GMT"} })
16522024-08-22T03:16:53.508ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 269.545349ms iteration = 11 status = {}
16532024-08-22T03:16:53.509ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
16542024-08-22T03:16:53.509ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0d8e1f21-5be0-4027-bc35-ae69bb9a7714", "content-length": "691", "date": "Thu, 22 Aug 2024 03:16:52 GMT"} })
16552024-08-22T03:16:53.509ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
16562024-08-22T03:16:53.509ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
16572024-08-22T03:16:53.509ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
16582024-08-22T03:16:53.511ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 272.442115ms iteration = 10 status = {}
16592024-08-22T03:16:53.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16602024-08-22T03:16:53.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16612024-08-22T03:16:53.569ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
16622024-08-22T03:16:53.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16632024-08-22T03:16:53.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16642024-08-22T03:16:53.574ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
16652024-08-22T03:16:53.575ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b887a9df-4a3f-4561-9c73-ea29409d486f", "content-length": "121", "date": "Thu, 22 Aug 2024 03:16:53 GMT"} })
16662024-08-22T03:16:53.575ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
16672024-08-22T03:16:53.575ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
16682024-08-22T03:16:53.575ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16692024-08-22T03:16:53.575ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16702024-08-22T03:16:53.575ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
16712024-08-22T03:16:53.575ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
16722024-08-22T03:16:53.575ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
16732024-08-22T03:16:53.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16742024-08-22T03:16:53.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16752024-08-22T03:16:53.577ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
16762024-08-22T03:16:53.577ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6e2039cc-9170-429d-8e31-1e60a4caebd7", "content-length": "2", "date": "Thu, 22 Aug 2024 03:16:53 GMT"} })
16772024-08-22T03:16:53.577ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
16782024-08-22T03:16:53.577ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "152af829-4f90-40fb-b560-663dfdd96851", "content-length": "51", "date": "Thu, 22 Aug 2024 03:16:53 GMT"} })
16792024-08-22T03:16:53.577ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
16802024-08-22T03:16:53.577ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16812024-08-22T03:16:53.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 6cdb1c70-6d95-4896-b56d-efff5f66b101 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
16822024-08-22T03:16:53.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 6cdb1c70-6d95-4896-b56d-efff5f66b101 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
16832024-08-22T03:16:53.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 6cdb1c70-6d95-4896-b56d-efff5f66b101 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
16842024-08-22T03:16:53.672ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "19368213-0ce4-4596-ab5c-67e075cc5ba7", "date": "Thu, 22 Aug 2024 03:16:53 GMT"} })
16852024-08-22T03:16:53.672ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
16862024-08-22T03:16:53.672ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16872024-08-22T03:16:53.672ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f86b60d3-456d-41d4-8d9c-e2e921ae5223", "content-length": "667", "date": "Thu, 22 Aug 2024 03:16:53 GMT"} })
16882024-08-22T03:16:53.672ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16892024-08-22T03:16:53.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16902024-08-22T03:16:53.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16912024-08-22T03:16:53.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16922024-08-22T03:16:53.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16932024-08-22T03:16:53.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16942024-08-22T03:16:53.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16952024-08-22T03:16:53.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16962024-08-22T03:16:53.688ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 449.41444ms iteration = 10 status = {}
16972024-08-22T03:16:54.213ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 37821b64-f51b-46c0-b756-36b0075ad837 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
16982024-08-22T03:16:54.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 37821b64-f51b-46c0-b756-36b0075ad837 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
16992024-08-22T03:16:54.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 37821b64-f51b-46c0-b756-36b0075ad837 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17002024-08-22T03:16:54.441ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1422 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = c2582dfb-eb52-4d6c-a99b-7d1627597fa0 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
17012024-08-22T03:16:55.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a9afb4a2-3e57-4393-a408-d13d67bf8da8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17022024-08-22T03:16:55.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a9afb4a2-3e57-4393-a408-d13d67bf8da8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17032024-08-22T03:16:55.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a9afb4a2-3e57-4393-a408-d13d67bf8da8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17042024-08-22T03:16:56.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 58dced48-6edd-49cc-964d-e0461cab90b2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17052024-08-22T03:16:56.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 58dced48-6edd-49cc-964d-e0461cab90b2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17062024-08-22T03:16:56.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1782 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 58dced48-6edd-49cc-964d-e0461cab90b2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17072024-08-22T03:16:57.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8925fd44-98f4-4c8e-a508-376d246ce417 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17082024-08-22T03:16:57.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8925fd44-98f4-4c8e-a508-376d246ce417 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17092024-08-22T03:16:57.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2342 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8925fd44-98f4-4c8e-a508-376d246ce417 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17102024-08-22T03:16:58.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = adfb23d5-5292-438d-9dbc-fa9ee6dfc522 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17112024-08-22T03:16:58.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = adfb23d5-5292-438d-9dbc-fa9ee6dfc522 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17122024-08-22T03:16:58.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = adfb23d5-5292-438d-9dbc-fa9ee6dfc522 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17132024-08-22T03:16:59.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61ecf084-b8b8-4003-ac4b-8648c163d75b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17142024-08-22T03:16:59.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61ecf084-b8b8-4003-ac4b-8648c163d75b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17152024-08-22T03:16:59.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 61ecf084-b8b8-4003-ac4b-8648c163d75b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17162024-08-22T03:17:00.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cfcbbca-860a-4dcf-b801-bf4035459253 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17172024-08-22T03:17:00.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cfcbbca-860a-4dcf-b801-bf4035459253 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17182024-08-22T03:17:00.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cfcbbca-860a-4dcf-b801-bf4035459253 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17192024-08-22T03:17:01.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 76c666c7-8a9d-4973-8eed-a3258d1a0e93 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17202024-08-22T03:17:01.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 76c666c7-8a9d-4973-8eed-a3258d1a0e93 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17212024-08-22T03:17:01.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 76c666c7-8a9d-4973-8eed-a3258d1a0e93 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17222024-08-22T03:17:02.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a7fad6a0-4ad2-4af9-b21b-cc5314dc3e6a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17232024-08-22T03:17:02.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a7fad6a0-4ad2-4af9-b21b-cc5314dc3e6a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17242024-08-22T03:17:02.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a7fad6a0-4ad2-4af9-b21b-cc5314dc3e6a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17252024-08-22T03:17:03.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
17262024-08-22T03:17:03.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17272024-08-22T03:17:03.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17282024-08-22T03:17:03.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17292024-08-22T03:17:03.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
17302024-08-22T03:17:03.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17312024-08-22T03:17:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17322024-08-22T03:17:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17332024-08-22T03:17:03.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17342024-08-22T03:17:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17352024-08-22T03:17:03.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17362024-08-22T03:17:03.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17372024-08-22T03:17:03.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17382024-08-22T03:17:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17392024-08-22T03:17:03.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17402024-08-22T03:17:03.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.082468ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17412024-08-22T03:17:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
17422024-08-22T03:17:03.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17432024-08-22T03:17:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17442024-08-22T03:17:03.251ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
17452024-08-22T03:17:03.251ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.617703ms iteration = 29 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
17462024-08-22T03:17:03.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fda126aa-c69b-4046-a480-1cd78dd684b3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17472024-08-22T03:17:03.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fda126aa-c69b-4046-a480-1cd78dd684b3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17482024-08-22T03:17:03.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fda126aa-c69b-4046-a480-1cd78dd684b3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17492024-08-22T03:17:04.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2deeeee9-dfa0-4b4f-969d-19ec865bde29 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17502024-08-22T03:17:04.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2deeeee9-dfa0-4b4f-969d-19ec865bde29 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17512024-08-22T03:17:04.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2190 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2deeeee9-dfa0-4b4f-969d-19ec865bde29 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17522024-08-22T03:17:04.441ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1380 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = edaa4582-c33b-421a-9f76-2ee0ac7a0bb2 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
17532024-08-22T03:17:05.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 808b9ccb-4afb-4f73-82ff-b44bdf546ec6 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17542024-08-22T03:17:05.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 808b9ccb-4afb-4f73-82ff-b44bdf546ec6 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17552024-08-22T03:17:05.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2280 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 808b9ccb-4afb-4f73-82ff-b44bdf546ec6 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17562024-08-22T03:17:06.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0ca2d5af-b730-4eb9-b4a2-6e5a62620de5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17572024-08-22T03:17:06.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0ca2d5af-b730-4eb9-b4a2-6e5a62620de5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17582024-08-22T03:17:06.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0ca2d5af-b730-4eb9-b4a2-6e5a62620de5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17592024-08-22T03:17:07.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d2726629-8d9d-4290-b5d8-369887a46bd2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17602024-08-22T03:17:07.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d2726629-8d9d-4290-b5d8-369887a46bd2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17612024-08-22T03:17:07.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2541 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d2726629-8d9d-4290-b5d8-369887a46bd2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17622024-08-22T03:17:08.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 63b5896c-6ab1-4772-932a-d3089abb1a5b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17632024-08-22T03:17:08.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 63b5896c-6ab1-4772-932a-d3089abb1a5b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17642024-08-22T03:17:08.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 63b5896c-6ab1-4772-932a-d3089abb1a5b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17652024-08-22T03:17:09.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1ee9a33d-c0e0-459b-964e-65e6561eb69e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17662024-08-22T03:17:09.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1ee9a33d-c0e0-459b-964e-65e6561eb69e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17672024-08-22T03:17:09.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1ee9a33d-c0e0-459b-964e-65e6561eb69e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17682024-08-22T03:17:10.552ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = af49e0e9-0584-4bfd-a7ba-ce0a378dbcb0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17692024-08-22T03:17:10.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = af49e0e9-0584-4bfd-a7ba-ce0a378dbcb0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17702024-08-22T03:17:10.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = af49e0e9-0584-4bfd-a7ba-ce0a378dbcb0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17712024-08-22T03:17:11.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 511ef112-72f2-4751-b926-9cc185c05169 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17722024-08-22T03:17:11.574ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 511ef112-72f2-4751-b926-9cc185c05169 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17732024-08-22T03:17:11.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 511ef112-72f2-4751-b926-9cc185c05169 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17742024-08-22T03:17:12.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9e4941b7-50ac-4364-b328-29e053687c0d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17752024-08-22T03:17:12.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9e4941b7-50ac-4364-b328-29e053687c0d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17762024-08-22T03:17:12.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9e4941b7-50ac-4364-b328-29e053687c0d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17772024-08-22T03:17:13.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
17782024-08-22T03:17:13.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17792024-08-22T03:17:13.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17802024-08-22T03:17:13.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17812024-08-22T03:17:13.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
17822024-08-22T03:17:13.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17832024-08-22T03:17:13.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17842024-08-22T03:17:13.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17852024-08-22T03:17:13.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17862024-08-22T03:17:13.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17872024-08-22T03:17:13.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17882024-08-22T03:17:13.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17892024-08-22T03:17:13.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.909777ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17902024-08-22T03:17:13.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17912024-08-22T03:17:13.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17922024-08-22T03:17:13.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17932024-08-22T03:17:13.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
17942024-08-22T03:17:13.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17952024-08-22T03:17:13.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17962024-08-22T03:17:13.251ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
17972024-08-22T03:17:13.251ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.536003ms iteration = 30 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
17982024-08-22T03:17:13.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 39af1ec1-904f-4132-8705-587011e882f2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
17992024-08-22T03:17:13.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 39af1ec1-904f-4132-8705-587011e882f2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18002024-08-22T03:17:13.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 39af1ec1-904f-4132-8705-587011e882f2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18012024-08-22T03:17:14.441ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1426 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 6a3e42f6-2b25-4ec4-b0a3-fd1b525ac56e response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
18022024-08-22T03:17:14.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 768e197e-61c0-453f-a8d2-35bc9eea640c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18032024-08-22T03:17:14.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 768e197e-61c0-453f-a8d2-35bc9eea640c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18042024-08-22T03:17:14.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 768e197e-61c0-453f-a8d2-35bc9eea640c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18052024-08-22T03:17:15.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b45eed17-e0e4-4a88-91ee-3edd53525f42 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18062024-08-22T03:17:15.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b45eed17-e0e4-4a88-91ee-3edd53525f42 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18072024-08-22T03:17:15.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b45eed17-e0e4-4a88-91ee-3edd53525f42 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18082024-08-22T03:17:16.678ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d250e19e-4309-4ac5-b125-b458e2247585 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18092024-08-22T03:17:16.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d250e19e-4309-4ac5-b125-b458e2247585 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18102024-08-22T03:17:16.680ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d250e19e-4309-4ac5-b125-b458e2247585 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18112024-08-22T03:17:17.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 04a2e0c1-307e-42bf-a1fa-e860d0b558e4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18122024-08-22T03:17:17.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 04a2e0c1-307e-42bf-a1fa-e860d0b558e4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18132024-08-22T03:17:17.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 04a2e0c1-307e-42bf-a1fa-e860d0b558e4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18142024-08-22T03:17:18.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dbc25604-d080-4818-bfda-254b74479a2f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18152024-08-22T03:17:18.722ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dbc25604-d080-4818-bfda-254b74479a2f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18162024-08-22T03:17:18.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dbc25604-d080-4818-bfda-254b74479a2f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18172024-08-22T03:17:19.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e988579c-9b9c-4c71-9ceb-145854c02d3e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18182024-08-22T03:17:19.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e988579c-9b9c-4c71-9ceb-145854c02d3e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18192024-08-22T03:17:19.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e988579c-9b9c-4c71-9ceb-145854c02d3e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18202024-08-22T03:17:20.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db7639c3-3042-47f4-ac86-504399024d0e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18212024-08-22T03:17:20.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db7639c3-3042-47f4-ac86-504399024d0e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18222024-08-22T03:17:20.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db7639c3-3042-47f4-ac86-504399024d0e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18232024-08-22T03:17:21.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aab823f1-51b7-4b3a-a201-69006ae2ce92 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18242024-08-22T03:17:21.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aab823f1-51b7-4b3a-a201-69006ae2ce92 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18252024-08-22T03:17:21.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aab823f1-51b7-4b3a-a201-69006ae2ce92 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18262024-08-22T03:17:22.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c80af957-39d2-49e4-b139-2fbfe27ac551 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18272024-08-22T03:17:22.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c80af957-39d2-49e4-b139-2fbfe27ac551 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18282024-08-22T03:17:22.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c80af957-39d2-49e4-b139-2fbfe27ac551 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
18292024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
18302024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
18312024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
18322024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
18332024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
18342024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
18352024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18362024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
18372024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
18382024-08-22T03:17:23.237ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = bff907f0-2101-418e-8f5d-955661c8bd6f
18392024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
18402024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.45\u{b5}s iteration = 7 status = {"error":"blueprint disabled","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f"}
18412024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18422024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
18432024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18442024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
18452024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
18462024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18472024-08-22T03:17:23.237ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-22 03:07:23.237377156 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
18482024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
18492024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
18502024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
18512024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
18522024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18532024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18542024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18552024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18562024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18572024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18582024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18592024-08-22T03:17:23.237ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3ce7517f-82f9-4849-ad08-7cb0bf67f024.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 759146114 } })
18602024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18612024-08-22T03:17:23.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18622024-08-22T03:17:23.238ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
18632024-08-22T03:17:23.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18642024-08-22T03:17:23.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18652024-08-22T03:17:23.239ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1467044e-2fe8-4015-be86-a3faa36f1469.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64fff417-46fd-44ed-ac7e-a3829d9efa54.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 760320649 } })
18662024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18672024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18682024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18692024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
18702024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.886813ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
18712024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
18722024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
18732024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18742024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
18752024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18762024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18772024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
18782024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18792024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
18802024-08-22T03:17:23.239ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
18812024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
18822024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
18832024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
18842024-08-22T03:17:23.239ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
18852024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18862024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
18872024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18882024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
18892024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
18902024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
18912024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
18922024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
18932024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18942024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
18952024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18962024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
18972024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18982024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18992024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
19002024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19012024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.36455ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
19022024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
19032024-08-22T03:17:23.239ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
19042024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19052024-08-22T03:17:23.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19062024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19072024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19082024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
19092024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19102024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19112024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19122024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19132024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19142024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19152024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
19162024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19172024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
19182024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19192024-08-22T03:17:23.240ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-22 03:07:23.237377156 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
19202024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.069939ms iteration = 6 status = {"expiration":"2024-08-22T03:07:23.237377156Z","pruned":[]}
19212024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19222024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19232024-08-22T03:17:23.240ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
19242024-08-22T03:17:23.241ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 3.693556ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
19252024-08-22T03:17:23.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19262024-08-22T03:17:23.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19272024-08-22T03:17:23.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19282024-08-22T03:17:23.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19292024-08-22T03:17:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19302024-08-22T03:17:23.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19312024-08-22T03:17:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19322024-08-22T03:17:23.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 763415308 } })
19332024-08-22T03:17:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19342024-08-22T03:17:23.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
19352024-08-22T03:17:23.242ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
19362024-08-22T03:17:23.242ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
19372024-08-22T03:17:23.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19382024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
19392024-08-22T03:17:23.243ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
19402024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 3.511304ms iteration = 6 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
19412024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19422024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19432024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19442024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19452024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19462024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19472024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19482024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19492024-08-22T03:17:23.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 765108369 } })
19502024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19512024-08-22T03:17:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19522024-08-22T03:17:23.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
19532024-08-22T03:17:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
19542024-08-22T03:17:23.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19552024-08-22T03:17:23.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19562024-08-22T03:17:23.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.666189ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19572024-08-22T03:17:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19582024-08-22T03:17:23.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19592024-08-22T03:17:23.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19602024-08-22T03:17:23.244ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.393728ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
19612024-08-22T03:17:23.245ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
19622024-08-22T03:17:23.245ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19632024-08-22T03:17:23.245ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.58745ms iteration = 11 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
19642024-08-22T03:17:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19652024-08-22T03:17:23.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.702532ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
19662024-08-22T03:17:23.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19672024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19682024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19692024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.770325ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
19702024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19712024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19722024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
19732024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19742024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19752024-08-22T03:17:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19762024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
19772024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
19782024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
19792024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19802024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19812024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19822024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19832024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19842024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19852024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
19862024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
19872024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
19882024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19892024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19902024-08-22T03:17:23.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.285504ms iteration = 11 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
19912024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19922024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19932024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19942024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
19952024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19962024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19972024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
19982024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19992024-08-22T03:17:23.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20002024-08-22T03:17:23.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20012024-08-22T03:17:23.249ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20022024-08-22T03:17:23.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 10.213398ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20032024-08-22T03:17:23.249ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20042024-08-22T03:17:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20052024-08-22T03:17:23.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20062024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20072024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20082024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20092024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20102024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20112024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20122024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20132024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20142024-08-22T03:17:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
20152024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20162024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20172024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20182024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20192024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
20202024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
20212024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20222024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20232024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
20242024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20252024-08-22T03:17:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20262024-08-22T03:17:23.252ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20272024-08-22T03:17:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20282024-08-22T03:17:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20292024-08-22T03:17:23.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20302024-08-22T03:17:23.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 773906469 } })
20312024-08-22T03:17:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20322024-08-22T03:17:23.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20332024-08-22T03:17:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20342024-08-22T03:17:23.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20352024-08-22T03:17:23.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20362024-08-22T03:17:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20372024-08-22T03:17:23.253ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
20382024-08-22T03:17:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20392024-08-22T03:17:23.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20402024-08-22T03:17:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20412024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20422024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20432024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20442024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20452024-08-22T03:17:23.254ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
20462024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 14.847727ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20472024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20482024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20492024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20502024-08-22T03:17:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20512024-08-22T03:17:23.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20522024-08-22T03:17:23.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20532024-08-22T03:17:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20542024-08-22T03:17:23.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20552024-08-22T03:17:23.256ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20562024-08-22T03:17:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20572024-08-22T03:17:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
20582024-08-22T03:17:23.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20592024-08-22T03:17:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20602024-08-22T03:17:23.258ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20612024-08-22T03:17:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20622024-08-22T03:17:23.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20632024-08-22T03:17:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20642024-08-22T03:17:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20652024-08-22T03:17:23.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20662024-08-22T03:17:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20672024-08-22T03:17:23.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
20682024-08-22T03:17:23.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.18857ms iteration = 31 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
20692024-08-22T03:17:23.260ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20702024-08-22T03:17:23.260ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
20712024-08-22T03:17:23.260ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20722024-08-22T03:17:23.260ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-22 03:13:02.692706 UTC dns_group = internal generation = 1
20732024-08-22T03:17:23.260ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 23.116201ms iteration = 7 status = {"generation":1}
20742024-08-22T03:17:23.261ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20752024-08-22T03:17:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20762024-08-22T03:17:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
20772024-08-22T03:17:23.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20782024-08-22T03:17:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20792024-08-22T03:17:23.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20802024-08-22T03:17:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20812024-08-22T03:17:23.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20822024-08-22T03:17:23.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20832024-08-22T03:17:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20842024-08-22T03:17:23.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20852024-08-22T03:17:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
20862024-08-22T03:17:23.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20872024-08-22T03:17:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20882024-08-22T03:17:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20892024-08-22T03:17:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 28.271665ms iteration = 11 status = 0
20902024-08-22T03:17:23.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20912024-08-22T03:17:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20922024-08-22T03:17:23.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20932024-08-22T03:17:23.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20942024-08-22T03:17:23.269ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 30.408162ms iteration = 14 status = {"physical_disks_added":0}
20952024-08-22T03:17:23.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20962024-08-22T03:17:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20972024-08-22T03:17:23.270ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
20982024-08-22T03:17:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
20992024-08-22T03:17:23.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21002024-08-22T03:17:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
21012024-08-22T03:17:23.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21022024-08-22T03:17:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21032024-08-22T03:17:23.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21042024-08-22T03:17:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21052024-08-22T03:17:23.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21062024-08-22T03:17:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21072024-08-22T03:17:23.278ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21082024-08-22T03:17:23.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21092024-08-22T03:17:23.279ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21102024-08-22T03:17:23.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21112024-08-22T03:17:23.279ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
21122024-08-22T03:17:23.279ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 0 version = 2
21132024-08-22T03:17:23.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21142024-08-22T03:17:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21152024-08-22T03:17:23.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21162024-08-22T03:17:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21172024-08-22T03:17:23.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21182024-08-22T03:17:23.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21192024-08-22T03:17:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21202024-08-22T03:17:23.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21212024-08-22T03:17:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
21222024-08-22T03:17:23.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
21232024-08-22T03:17:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
21242024-08-22T03:17:23.285ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 1 version = 2
21252024-08-22T03:17:23.285ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
21262024-08-22T03:17:23.285ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-22 03:13:03.125979 UTC dns_group = external generation = 2
21272024-08-22T03:17:23.285ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 48.155595ms iteration = 7 status = {"generation":2}
21282024-08-22T03:17:23.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
21292024-08-22T03:17:23.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21302024-08-22T03:17:23.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21312024-08-22T03:17:23.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21322024-08-22T03:17:23.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21332024-08-22T03:17:23.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21342024-08-22T03:17:23.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21352024-08-22T03:17:23.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21362024-08-22T03:17:23.290ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21372024-08-22T03:17:23.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21382024-08-22T03:17:23.291ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21392024-08-22T03:17:23.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
21402024-08-22T03:17:23.291ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21412024-08-22T03:17:23.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21422024-08-22T03:17:23.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21432024-08-22T03:17:23.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21442024-08-22T03:17:23.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21452024-08-22T03:17:23.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21462024-08-22T03:17:23.294ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-22T03:12:22.052278Z, time_modified: 2024-08-22T03:12:22.052278Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }) }
21472024-08-22T03:17:23.294ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 57.053817ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]}},"default_endpoint":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
21482024-08-22T03:17:23.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21492024-08-22T03:17:23.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21502024-08-22T03:17:23.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21512024-08-22T03:17:23.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21522024-08-22T03:17:23.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21532024-08-22T03:17:23.296ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21542024-08-22T03:17:23.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21552024-08-22T03:17:23.297ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21562024-08-22T03:17:23.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21572024-08-22T03:17:23.299ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21582024-08-22T03:17:23.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21592024-08-22T03:17:23.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21602024-08-22T03:17:23.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21612024-08-22T03:17:23.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21622024-08-22T03:17:23.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21632024-08-22T03:17:23.302ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21642024-08-22T03:17:23.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21652024-08-22T03:17:23.303ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21662024-08-22T03:17:23.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
21672024-08-22T03:17:23.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21682024-08-22T03:17:23.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21692024-08-22T03:17:23.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21702024-08-22T03:17:23.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21712024-08-22T03:17:23.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21722024-08-22T03:17:23.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21732024-08-22T03:17:23.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21742024-08-22T03:17:23.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
21752024-08-22T03:17:23.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21762024-08-22T03:17:23.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21772024-08-22T03:17:23.316ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 0673aabd-3541-41cb-a886-23cdd3680f8f, kind: Service { id: 3ce7517f-82f9-4849-ad08-7cb0bf67f024 }, name: Name("external-dns-3ce7517f-82f9-4849-ad08-7cb0bf67f024"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 82])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ddeaf620-1944-4d2d-84d8-d718e3140255, kind: Service { id: 5a597bdf-a19f-4440-a5c9-c0ad27e590c2 }, name: Name("external-dns-5a597bdf-a19f-4440-a5c9-c0ad27e590c2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 53db6911-139a-448a-8c1b-7f8603cf520e, kind: Service { id: 3402f0c0-4afe-4d3a-ad22-fcd268662ca5 }, name: Name("nexus-3402f0c0-4afe-4d3a-ad22-fcd268662ca5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7758080c-490c-471f-9344-372483ce67bb, kind: Service { id: 3fd8dca3-b16c-4e0d-a7ea-81aa9fb66990 }, name: Name("nexus-3fd8dca3-b16c-4e0d-a7ea-81aa9fb66990"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 108])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cafe4faf-492c-4ce6-b87e-956f525f7351, kind: Service { id: 6704b89b-0851-45e8-ae6a-571db6735f05 }, name: Name("nexus-6704b89b-0851-45e8-ae6a-571db6735f05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
21782024-08-22T03:17:23.316ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21792024-08-22T03:17:23.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21802024-08-22T03:17:23.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21812024-08-22T03:17:23.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
21822024-08-22T03:17:23.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21832024-08-22T03:17:23.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21842024-08-22T03:17:23.319ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
21852024-08-22T03:17:23.319ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0673aabd-3541-41cb-a886-23cdd3680f8f, kind: Service { id: 3ce7517f-82f9-4849-ad08-7cb0bf67f024 }, name: Name("external-dns-3ce7517f-82f9-4849-ad08-7cb0bf67f024"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 82])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ddeaf620-1944-4d2d-84d8-d718e3140255, kind: Service { id: 5a597bdf-a19f-4440-a5c9-c0ad27e590c2 }, name: Name("external-dns-5a597bdf-a19f-4440-a5c9-c0ad27e590c2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 53db6911-139a-448a-8c1b-7f8603cf520e, kind: Service { id: 3402f0c0-4afe-4d3a-ad22-fcd268662ca5 }, name: Name("nexus-3402f0c0-4afe-4d3a-ad22-fcd268662ca5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7758080c-490c-471f-9344-372483ce67bb, kind: Service { id: 3fd8dca3-b16c-4e0d-a7ea-81aa9fb66990 }, name: Name("nexus-3fd8dca3-b16c-4e0d-a7ea-81aa9fb66990"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 108])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cafe4faf-492c-4ce6-b87e-956f525f7351, kind: Service { id: 6704b89b-0851-45e8-ae6a-571db6735f05 }, name: Name("nexus-6704b89b-0851-45e8-ae6a-571db6735f05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
21862024-08-22T03:17:23.319ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
21872024-08-22T03:17:23.344ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, time_created: 2024-08-22T03:12:55.365680Z, time_modified: 2024-08-22T03:12:55.365680Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
21882024-08-22T03:17:23.344ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
21892024-08-22T03:17:23.344ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21902024-08-22T03:17:23.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21912024-08-22T03:17:23.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
21922024-08-22T03:17:23.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
21932024-08-22T03:17:23.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21942024-08-22T03:17:23.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
21952024-08-22T03:17:23.416ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
21962024-08-22T03:17:23.460ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
21972024-08-22T03:17:23.460ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21982024-08-22T03:17:23.460ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
21992024-08-22T03:17:23.461ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22002024-08-22T03:17:23.461ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1d64d13f-4140-4cdd-8aeb-695dc08fd2bd", "content-length": "26", "date": "Thu, 22 Aug 2024 03:17:22 GMT"} })
22012024-08-22T03:17:23.461ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22022024-08-22T03:17:23.461ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "89557aa5-735b-4a8b-905e-8650c374ac52", "content-length": "26", "date": "Thu, 22 Aug 2024 03:17:22 GMT"} })
22032024-08-22T03:17:23.461ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22042024-08-22T03:17:23.463ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
22052024-08-22T03:17:23.464ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22062024-08-22T03:17:23.509ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
22072024-08-22T03:17:23.527ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
22082024-08-22T03:17:23.527ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b219fb7e-1db5-47e9-a869-9ddaafc173ff", "content-length": "691", "date": "Thu, 22 Aug 2024 03:17:22 GMT"} })
22092024-08-22T03:17:23.527ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
22102024-08-22T03:17:23.527ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
22112024-08-22T03:17:23.527ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
22122024-08-22T03:17:23.529ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 289.842794ms iteration = 11 status = {}
22132024-08-22T03:17:23.580ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
22142024-08-22T03:17:23.580ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
22152024-08-22T03:17:23.580ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4b32ab37-bc04-4da2-9aab-95607bdcb698", "content-length": "26", "date": "Thu, 22 Aug 2024 03:17:22 GMT"} })
22162024-08-22T03:17:23.580ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
22172024-08-22T03:17:23.583ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
22182024-08-22T03:17:23.593ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22192024-08-22T03:17:23.593ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54d18346-8314-4c0d-adb4-5aefc86235da", "content-length": "372", "date": "Thu, 22 Aug 2024 03:17:22 GMT"} })
22202024-08-22T03:17:23.593ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22212024-08-22T03:17:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22222024-08-22T03:17:23.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22232024-08-22T03:17:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22242024-08-22T03:17:23.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22252024-08-22T03:17:23.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22262024-08-22T03:17:23.600ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22272024-08-22T03:17:23.600ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "50fd746a-141b-4a02-aa95-610a8364bb16", "date": "Thu, 22 Aug 2024 03:17:22 GMT"} })
22282024-08-22T03:17:23.601ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 362.331216ms iteration = 12 status = {}
22292024-08-22T03:17:23.637ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
22302024-08-22T03:17:23.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = b2a5ec2a-4a1c-4fa8-a22a-6181858cb499 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
22312024-08-22T03:17:23.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = b2a5ec2a-4a1c-4fa8-a22a-6181858cb499 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
22322024-08-22T03:17:23.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = b2a5ec2a-4a1c-4fa8-a22a-6181858cb499 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
22332024-08-22T03:17:23.754ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51838
22342024-08-22T03:17:23.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51838 req_id = 1ebeb73e-2d0f-4c70-9029-51b2307f16bd roles = RoleSet { roles: {} } uri = /metrics/producers
22352024-08-22T03:17:23.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51838 req_id = 1ebeb73e-2d0f-4c70-9029-51b2307f16bd resource = Database result = Ok(()) uri = /metrics/producers
22362024-08-22T03:17:23.802ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22372024-08-22T03:17:23.802ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b8312b52-f80d-433b-b061-ae0993dbca30", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} })
22382024-08-22T03:17:23.804ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
22392024-08-22T03:17:23.804ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 565.450819ms
22402024-08-22T03:17:23.805ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 565.458179ms iteration = 2 status = {}
22412024-08-22T03:17:23.827ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 31da9e2a-46f4-452a-abaf-b7ffb58d91d1 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
22422024-08-22T03:17:23.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 31da9e2a-46f4-452a-abaf-b7ffb58d91d1 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
22432024-08-22T03:17:23.829ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
22442024-08-22T03:17:23.829ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a9ac5de4-b756-4b12-b8a9-5af08360d95e", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22452024-08-22T03:17:23.829ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22462024-08-22T03:17:23.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 31da9e2a-46f4-452a-abaf-b7ffb58d91d1 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
22472024-08-22T03:17:23.831ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1f179a59-3e65-4906-b35a-973bce1e183f", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22482024-08-22T03:17:23.831ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22492024-08-22T03:17:23.833ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "368b2ad8-558d-432d-9632-eab22dc4f3a8", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22502024-08-22T03:17:23.833ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22512024-08-22T03:17:23.836ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
22522024-08-22T03:17:23.836ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 598.809778ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
22532024-08-22T03:17:23.879ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 641.882ms iteration = 11 status = {}
22542024-08-22T03:17:23.892ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
22552024-08-22T03:17:23.892ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d4a71093-ca4f-4bb1-b208-188acb9f559e", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22562024-08-22T03:17:23.892ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22572024-08-22T03:17:23.895ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5c31e283-8950-4049-9e21-ba854188f2ab", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22582024-08-22T03:17:23.895ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22592024-08-22T03:17:23.896ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
22602024-08-22T03:17:23.896ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 659.458301ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
22612024-08-22T03:17:23.898ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
22622024-08-22T03:17:23.898ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "391e8477-e471-419a-8a19-d79cc94ac0c3", "content-length": "1", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} })
22632024-08-22T03:17:23.900ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
22642024-08-22T03:17:23.900ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
22652024-08-22T03:17:23.902ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 664.825518ms iteration = 11 status = null
22662024-08-22T03:17:23.906ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
22672024-08-22T03:17:23.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51838 req_id = 1ebeb73e-2d0f-4c70-9029-51b2307f16bd roles = RoleSet { roles: {} } uri = /metrics/producers
22682024-08-22T03:17:23.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51838 req_id = 1ebeb73e-2d0f-4c70-9029-51b2307f16bd resource = Database result = Ok(()) uri = /metrics/producers
22692024-08-22T03:17:23.945ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
22702024-08-22T03:17:23.945ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b8dbc03d-29e5-4280-a7f3-b3d748824cc7", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} })
22712024-08-22T03:17:23.945ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = e4d9dca8-f487-4ba1-85b6-d674be01f3cb
22722024-08-22T03:17:23.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 193595 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51838 req_id = 1ebeb73e-2d0f-4c70-9029-51b2307f16bd response_code = 201 uri = /metrics/producers
22732024-08-22T03:17:23.948ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22742024-08-22T03:17:23.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22752024-08-22T03:17:23.950ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
22762024-08-22T03:17:23.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22772024-08-22T03:17:23.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22782024-08-22T03:17:23.957ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
22792024-08-22T03:17:23.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d3c4b6c3-23aa-4606-bf49-cc59254ae4f6", "content-length": "121", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} })
22802024-08-22T03:17:23.958ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
22812024-08-22T03:17:23.958ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
22822024-08-22T03:17:23.958ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22832024-08-22T03:17:23.958ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
22842024-08-22T03:17:23.958ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
22852024-08-22T03:17:23.958ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
22862024-08-22T03:17:23.958ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
22872024-08-22T03:17:23.958ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22882024-08-22T03:17:23.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22892024-08-22T03:17:23.960ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
22902024-08-22T03:17:23.960ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "af023580-1bdb-4a72-bcb8-592780711f8b", "content-length": "2", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} })
22912024-08-22T03:17:23.960ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
22922024-08-22T03:17:23.960ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ad3374fa-d96b-45e9-8c39-c3eac4d21c2d", "content-length": "51", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} })
22932024-08-22T03:17:23.960ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
22942024-08-22T03:17:23.960ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
22952024-08-22T03:17:24.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e7a3d2eb-a3f4-4b44-a5ed-354735cbdb68", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} })
22962024-08-22T03:17:24.056ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
22972024-08-22T03:17:24.056ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
22982024-08-22T03:17:24.060ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8fd74979-6aa4-4f0a-985c-deecce310b8c", "content-length": "667", "date": "Thu, 22 Aug 2024 03:17:23 GMT"} })
22992024-08-22T03:17:24.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23002024-08-22T03:17:24.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23012024-08-22T03:17:24.063ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23022024-08-22T03:17:24.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23032024-08-22T03:17:24.066ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23042024-08-22T03:17:24.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23052024-08-22T03:17:24.068ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23062024-08-22T03:17:24.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
23072024-08-22T03:17:24.075ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 836.184823ms iteration = 11 status = {}
23082024-08-22T03:17:24.441ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1630 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 3b6bac86-fcd8-4f78-98e3-8f9af2c6e513 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
23092024-08-22T03:17:24.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b84f6f8f-8503-472a-b46b-f546c9af1eeb roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23102024-08-22T03:17:24.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b84f6f8f-8503-472a-b46b-f546c9af1eeb resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23112024-08-22T03:17:24.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b84f6f8f-8503-472a-b46b-f546c9af1eeb response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23122024-08-22T03:17:24.959ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:46907
23132024-08-22T03:17:24.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46907 req_id = a07f4d7a-dfea-42e9-a767-574c0f2cf1d2 roles = RoleSet { roles: {} } uri = /metrics/producers
23142024-08-22T03:17:24.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46907 req_id = a07f4d7a-dfea-42e9-a767-574c0f2cf1d2 resource = Database result = Ok(()) uri = /metrics/producers
23152024-08-22T03:17:24.991ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
23162024-08-22T03:17:24.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46907 req_id = a07f4d7a-dfea-42e9-a767-574c0f2cf1d2 roles = RoleSet { roles: {} } uri = /metrics/producers
23172024-08-22T03:17:24.991ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46907 req_id = a07f4d7a-dfea-42e9-a767-574c0f2cf1d2 resource = Database result = Ok(()) uri = /metrics/producers
23182024-08-22T03:17:25.001ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
23192024-08-22T03:17:25.001ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7dacb2de-19c4-4338-b648-98766f93a7ff", "date": "Thu, 22 Aug 2024 03:17:25 GMT"} })
23202024-08-22T03:17:25.001ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23212024-08-22T03:17:25.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42925 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:46907 req_id = a07f4d7a-dfea-42e9-a767-574c0f2cf1d2 response_code = 201 uri = /metrics/producers
23222024-08-22T03:17:25.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c16d9c7a-1703-4154-bcd3-a0423d010c60 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23232024-08-22T03:17:25.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c16d9c7a-1703-4154-bcd3-a0423d010c60 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23242024-08-22T03:17:25.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c16d9c7a-1703-4154-bcd3-a0423d010c60 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23252024-08-22T03:17:26.446ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:43725
23262024-08-22T03:17:26.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43725 req_id = 47e60483-159b-4262-b764-7d3e4aeff6d4 roles = RoleSet { roles: {} } uri = /metrics/producers
23272024-08-22T03:17:26.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43725 req_id = 47e60483-159b-4262-b764-7d3e4aeff6d4 resource = Database result = Ok(()) uri = /metrics/producers
23282024-08-22T03:17:26.479ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
23292024-08-22T03:17:26.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43725 req_id = 47e60483-159b-4262-b764-7d3e4aeff6d4 roles = RoleSet { roles: {} } uri = /metrics/producers
23302024-08-22T03:17:26.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43725 req_id = 47e60483-159b-4262-b764-7d3e4aeff6d4 resource = Database result = Ok(()) uri = /metrics/producers
23312024-08-22T03:17:26.488ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
23322024-08-22T03:17:26.488ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c98f84f8-830f-46c1-93fd-4080659796a0", "date": "Thu, 22 Aug 2024 03:17:26 GMT"} })
23332024-08-22T03:17:26.488ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = 23048a74-7858-48f9-b45b-63d0f73fea5c
23342024-08-22T03:17:26.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43293 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43725 req_id = 47e60483-159b-4262-b764-7d3e4aeff6d4 response_code = 201 uri = /metrics/producers
23352024-08-22T03:17:26.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 046628a5-c584-4bba-a79f-14e4dc2ac4cc roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23362024-08-22T03:17:26.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 046628a5-c584-4bba-a79f-14e4dc2ac4cc resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23372024-08-22T03:17:26.892ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 046628a5-c584-4bba-a79f-14e4dc2ac4cc response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23382024-08-22T03:17:27.428ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:52489
23392024-08-22T03:17:27.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52489 req_id = fb20863f-664d-4cc0-9d9b-2f1b6c7eb34f roles = RoleSet { roles: {} } uri = /metrics/producers
23402024-08-22T03:17:27.428ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52489 req_id = fb20863f-664d-4cc0-9d9b-2f1b6c7eb34f resource = Database result = Ok(()) uri = /metrics/producers
23412024-08-22T03:17:27.460ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
23422024-08-22T03:17:27.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52489 req_id = fb20863f-664d-4cc0-9d9b-2f1b6c7eb34f roles = RoleSet { roles: {} } uri = /metrics/producers
23432024-08-22T03:17:27.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52489 req_id = fb20863f-664d-4cc0-9d9b-2f1b6c7eb34f resource = Database result = Ok(()) uri = /metrics/producers
23442024-08-22T03:17:27.470ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
23452024-08-22T03:17:27.470ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d0d80c32-7ae9-4899-8ae7-ac11c18d51d7", "date": "Thu, 22 Aug 2024 03:17:26 GMT"} })
23462024-08-22T03:17:27.470ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = ce6ae16f-249c-4cde-9f29-e4f137631a2e
23472024-08-22T03:17:27.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 44457 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:52489 req_id = fb20863f-664d-4cc0-9d9b-2f1b6c7eb34f response_code = 201 uri = /metrics/producers
23482024-08-22T03:17:27.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0045b50a-3495-4c99-9b46-9aaba34cf76d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23492024-08-22T03:17:27.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0045b50a-3495-4c99-9b46-9aaba34cf76d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23502024-08-22T03:17:27.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2532 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0045b50a-3495-4c99-9b46-9aaba34cf76d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23512024-08-22T03:17:28.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f2f96b4e-4344-463c-a69f-c14b084746ff roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23522024-08-22T03:17:28.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f2f96b4e-4344-463c-a69f-c14b084746ff resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23532024-08-22T03:17:28.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f2f96b4e-4344-463c-a69f-c14b084746ff response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23542024-08-22T03:17:29.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = afcc9e43-c673-4a90-9e68-cc904d1d347d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23552024-08-22T03:17:29.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = afcc9e43-c673-4a90-9e68-cc904d1d347d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23562024-08-22T03:17:29.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = afcc9e43-c673-4a90-9e68-cc904d1d347d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23572024-08-22T03:17:30.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f84f5f3f-888c-4c3f-a747-2af2f67ad60d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23582024-08-22T03:17:30.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f84f5f3f-888c-4c3f-a747-2af2f67ad60d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23592024-08-22T03:17:30.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f84f5f3f-888c-4c3f-a747-2af2f67ad60d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23602024-08-22T03:17:31.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 57a82917-f36c-4a9d-b1ae-62a4b6992edd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23612024-08-22T03:17:31.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 57a82917-f36c-4a9d-b1ae-62a4b6992edd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23622024-08-22T03:17:31.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 57a82917-f36c-4a9d-b1ae-62a4b6992edd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23632024-08-22T03:17:32.052ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:33462
23642024-08-22T03:17:32.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33462 req_id = 77a2135d-b61f-48e1-afca-80449cbc91e5 roles = RoleSet { roles: {} } uri = /metrics/producers
23652024-08-22T03:17:32.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33462 req_id = 77a2135d-b61f-48e1-afca-80449cbc91e5 resource = Database result = Ok(()) uri = /metrics/producers
23662024-08-22T03:17:32.084ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
23672024-08-22T03:17:32.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33462 req_id = 77a2135d-b61f-48e1-afca-80449cbc91e5 roles = RoleSet { roles: {} } uri = /metrics/producers
23682024-08-22T03:17:32.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33462 req_id = 77a2135d-b61f-48e1-afca-80449cbc91e5 resource = Database result = Ok(()) uri = /metrics/producers
23692024-08-22T03:17:32.089ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
23702024-08-22T03:17:32.090ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8ad4469e-6f18-4578-a49d-d8376ddc1895", "date": "Thu, 22 Aug 2024 03:17:32 GMT"} })
23712024-08-22T03:17:32.090ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = b136e605-e6c0-4cdf-94cc-94880650b9fc
23722024-08-22T03:17:32.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 38895 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33462 req_id = 77a2135d-b61f-48e1-afca-80449cbc91e5 response_code = 201 uri = /metrics/producers
23732024-08-22T03:17:33.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 138f253a-3dd8-4c61-a7b3-8fa00149cad0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23742024-08-22T03:17:33.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 138f253a-3dd8-4c61-a7b3-8fa00149cad0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23752024-08-22T03:17:33.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 138f253a-3dd8-4c61-a7b3-8fa00149cad0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23762024-08-22T03:17:33.236ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
23772024-08-22T03:17:33.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23782024-08-22T03:17:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23792024-08-22T03:17:33.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23802024-08-22T03:17:33.239ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
23812024-08-22T03:17:33.239ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23822024-08-22T03:17:33.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23832024-08-22T03:17:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23842024-08-22T03:17:33.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23852024-08-22T03:17:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23862024-08-22T03:17:33.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23872024-08-22T03:17:33.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23882024-08-22T03:17:33.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23892024-08-22T03:17:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23902024-08-22T03:17:33.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.941808ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23912024-08-22T03:17:33.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23922024-08-22T03:17:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
23932024-08-22T03:17:33.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23942024-08-22T03:17:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23952024-08-22T03:17:33.251ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
23962024-08-22T03:17:33.251ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.015029ms iteration = 32 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
23972024-08-22T03:17:34.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0c2f6ea5-353f-41f8-8879-876c2abab5a1 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23982024-08-22T03:17:34.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0c2f6ea5-353f-41f8-8879-876c2abab5a1 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
23992024-08-22T03:17:34.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1731 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0c2f6ea5-353f-41f8-8879-876c2abab5a1 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24002024-08-22T03:17:34.442ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 25505ed9-6d36-43c0-b26f-30dd5dd80807 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
24012024-08-22T03:17:35.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d09b3f4e-2d38-4387-af14-c30e35788b53 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24022024-08-22T03:17:35.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d09b3f4e-2d38-4387-af14-c30e35788b53 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24032024-08-22T03:17:35.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d09b3f4e-2d38-4387-af14-c30e35788b53 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24042024-08-22T03:17:36.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 07684b1b-b3f7-450c-9eec-41abdfb6e9dd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24052024-08-22T03:17:36.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 07684b1b-b3f7-450c-9eec-41abdfb6e9dd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24062024-08-22T03:17:36.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 07684b1b-b3f7-450c-9eec-41abdfb6e9dd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24072024-08-22T03:17:37.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49fbd556-dd1f-455f-a626-151f9bc40abf roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24082024-08-22T03:17:37.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49fbd556-dd1f-455f-a626-151f9bc40abf resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24092024-08-22T03:17:37.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49fbd556-dd1f-455f-a626-151f9bc40abf response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24102024-08-22T03:17:38.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c64341a-936b-48e2-b1c4-a54ba974c100 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24112024-08-22T03:17:38.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c64341a-936b-48e2-b1c4-a54ba974c100 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24122024-08-22T03:17:38.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1957 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c64341a-936b-48e2-b1c4-a54ba974c100 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24132024-08-22T03:17:39.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49a75e7a-854c-460c-aead-28133a4cb10b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24142024-08-22T03:17:39.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49a75e7a-854c-460c-aead-28133a4cb10b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24152024-08-22T03:17:39.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 49a75e7a-854c-460c-aead-28133a4cb10b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24162024-08-22T03:17:40.171ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c30c1290-3900-4842-988b-e1ef94f8df7b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24172024-08-22T03:17:40.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c30c1290-3900-4842-988b-e1ef94f8df7b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24182024-08-22T03:17:40.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1813 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c30c1290-3900-4842-988b-e1ef94f8df7b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24192024-08-22T03:17:41.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 79002f13-15aa-4649-97fa-be31c41dfd55 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24202024-08-22T03:17:41.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 79002f13-15aa-4649-97fa-be31c41dfd55 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24212024-08-22T03:17:41.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 79002f13-15aa-4649-97fa-be31c41dfd55 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24222024-08-22T03:17:42.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6e6e90bc-ac78-44f5-8891-cae905417ddf roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24232024-08-22T03:17:42.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6e6e90bc-ac78-44f5-8891-cae905417ddf resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24242024-08-22T03:17:42.215ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2559 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6e6e90bc-ac78-44f5-8891-cae905417ddf response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24252024-08-22T03:17:43.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 459ec0dc-e254-47be-89e9-ce1f1a2f18c7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24262024-08-22T03:17:43.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 459ec0dc-e254-47be-89e9-ce1f1a2f18c7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24272024-08-22T03:17:43.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 459ec0dc-e254-47be-89e9-ce1f1a2f18c7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24282024-08-22T03:17:43.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
24292024-08-22T03:17:43.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24302024-08-22T03:17:43.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24312024-08-22T03:17:43.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24322024-08-22T03:17:43.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
24332024-08-22T03:17:43.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24342024-08-22T03:17:43.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24352024-08-22T03:17:43.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24362024-08-22T03:17:43.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24372024-08-22T03:17:43.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24382024-08-22T03:17:43.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24392024-08-22T03:17:43.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24402024-08-22T03:17:43.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24412024-08-22T03:17:43.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24422024-08-22T03:17:43.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.072368ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
24432024-08-22T03:17:43.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24442024-08-22T03:17:43.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
24452024-08-22T03:17:43.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24462024-08-22T03:17:43.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24472024-08-22T03:17:43.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
24482024-08-22T03:17:43.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.607786ms iteration = 33 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
24492024-08-22T03:17:44.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18b2b616-f279-48f1-a2bb-74ad0f99caff roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24502024-08-22T03:17:44.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18b2b616-f279-48f1-a2bb-74ad0f99caff resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24512024-08-22T03:17:44.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18b2b616-f279-48f1-a2bb-74ad0f99caff response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24522024-08-22T03:17:44.442ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1833 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 35abb064-742d-42e8-abfb-c306b6278bf9 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
24532024-08-22T03:17:45.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b79987d2-a961-4f46-a06f-941f1d50f9cc roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24542024-08-22T03:17:45.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b79987d2-a961-4f46-a06f-941f1d50f9cc resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24552024-08-22T03:17:45.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b79987d2-a961-4f46-a06f-941f1d50f9cc response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24562024-08-22T03:17:46.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c6e82bf-8eb9-4464-8c3a-5468625d7fb8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24572024-08-22T03:17:46.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c6e82bf-8eb9-4464-8c3a-5468625d7fb8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24582024-08-22T03:17:46.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c6e82bf-8eb9-4464-8c3a-5468625d7fb8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24592024-08-22T03:17:47.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fad2549c-bc8e-426a-bad6-439f8f4990b2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24602024-08-22T03:17:47.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fad2549c-bc8e-426a-bad6-439f8f4990b2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24612024-08-22T03:17:47.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fad2549c-bc8e-426a-bad6-439f8f4990b2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24622024-08-22T03:17:48.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 16d82efe-5185-4978-9a0b-80366477a436 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24632024-08-22T03:17:48.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 16d82efe-5185-4978-9a0b-80366477a436 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24642024-08-22T03:17:48.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 16d82efe-5185-4978-9a0b-80366477a436 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24652024-08-22T03:17:49.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ef5f8722-7907-4ecc-9bd8-722c0e4de825 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24662024-08-22T03:17:49.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ef5f8722-7907-4ecc-9bd8-722c0e4de825 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24672024-08-22T03:17:49.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ef5f8722-7907-4ecc-9bd8-722c0e4de825 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24682024-08-22T03:17:50.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9fd17e5a-0a0b-4b10-a7bf-18338a1b006a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24692024-08-22T03:17:50.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9fd17e5a-0a0b-4b10-a7bf-18338a1b006a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24702024-08-22T03:17:50.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9fd17e5a-0a0b-4b10-a7bf-18338a1b006a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24712024-08-22T03:17:51.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 69f0a208-d64f-436c-b05e-40e4397f4c02 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24722024-08-22T03:17:51.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 69f0a208-d64f-436c-b05e-40e4397f4c02 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24732024-08-22T03:17:51.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 69f0a208-d64f-436c-b05e-40e4397f4c02 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24742024-08-22T03:17:52.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dea618e4-bf49-4a06-b4d3-9e63487f9121 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24752024-08-22T03:17:52.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dea618e4-bf49-4a06-b4d3-9e63487f9121 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24762024-08-22T03:17:52.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dea618e4-bf49-4a06-b4d3-9e63487f9121 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
24772024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
24782024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
24792024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
24802024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
24812024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
24822024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
24832024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24842024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24852024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24862024-08-22T03:17:53.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24872024-08-22T03:17:53.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24882024-08-22T03:17:53.239ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.890324ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24892024-08-22T03:17:53.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
24902024-08-22T03:17:53.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24912024-08-22T03:17:53.239ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 760281945 } })
24922024-08-22T03:17:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24932024-08-22T03:17:53.240ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 760566909 } })
24942024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
24962024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
24972024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
24982024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24992024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
25002024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
25012024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25022024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25032024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
25042024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25052024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
25062024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25072024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
25082024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25092024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
25102024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
25112024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
25122024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25132024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
25142024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
25152024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25162024-08-22T03:17:53.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
25172024-08-22T03:17:53.241ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
25182024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25192024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25202024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25212024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25222024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25232024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25242024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25252024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
25262024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
25272024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25282024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25292024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25302024-08-22T03:17:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25312024-08-22T03:17:53.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25322024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25332024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25342024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25352024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25362024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25372024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.33431ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
25382024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25392024-08-22T03:17:53.243ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
25402024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25412024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25422024-08-22T03:17:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25432024-08-22T03:17:53.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25442024-08-22T03:17:53.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.624556ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25452024-08-22T03:17:53.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25462024-08-22T03:17:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25472024-08-22T03:17:53.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25482024-08-22T03:17:53.245ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
25492024-08-22T03:17:53.245ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25502024-08-22T03:17:53.245ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 4.480446ms iteration = 12 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
25512024-08-22T03:17:53.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25522024-08-22T03:17:53.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25532024-08-22T03:17:53.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25542024-08-22T03:17:53.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25552024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25562024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25572024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25582024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
25592024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25602024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25612024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25622024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25632024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25642024-08-22T03:17:53.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25652024-08-22T03:17:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25662024-08-22T03:17:53.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.626733ms iteration = 12 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
25672024-08-22T03:17:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
25682024-08-22T03:17:53.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
25692024-08-22T03:17:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
25702024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25712024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25722024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
25732024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
25742024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25752024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
25762024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25772024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25782024-08-22T03:17:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25792024-08-22T03:17:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25802024-08-22T03:17:53.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25812024-08-22T03:17:53.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 769630293 } })
25822024-08-22T03:17:53.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
25832024-08-22T03:17:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
25842024-08-22T03:17:53.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
25852024-08-22T03:17:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
25862024-08-22T03:17:53.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25872024-08-22T03:17:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25882024-08-22T03:17:53.255ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25892024-08-22T03:17:53.255ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 14.361201ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25902024-08-22T03:17:53.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
25912024-08-22T03:17:53.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.219984ms iteration = 34 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
25922024-08-22T03:17:53.258ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 18.642984ms iteration = 15 status = {"physical_disks_added":0}
25932024-08-22T03:17:53.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25942024-08-22T03:17:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25952024-08-22T03:17:53.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25962024-08-22T03:17:53.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
25972024-08-22T03:17:53.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
25982024-08-22T03:17:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
25992024-08-22T03:17:53.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26002024-08-22T03:17:53.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26012024-08-22T03:17:53.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26022024-08-22T03:17:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26032024-08-22T03:17:53.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26042024-08-22T03:17:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26052024-08-22T03:17:53.269ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26062024-08-22T03:17:53.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26072024-08-22T03:17:53.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26082024-08-22T03:17:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
26092024-08-22T03:17:53.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26102024-08-22T03:17:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26112024-08-22T03:17:53.273ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 32.775352ms iteration = 12 status = 0
26122024-08-22T03:17:53.277ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 36.058953ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
26132024-08-22T03:17:53.371ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
26142024-08-22T03:17:53.371ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26152024-08-22T03:17:53.371ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0cd2eb76-7078-4261-8fcf-d8df690ce6cb", "content-length": "26", "date": "Thu, 22 Aug 2024 03:17:52 GMT"} })
26162024-08-22T03:17:53.371ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26172024-08-22T03:17:53.373ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26182024-08-22T03:17:53.387ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
26192024-08-22T03:17:53.387ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26202024-08-22T03:17:53.387ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e88d491e-303e-4a27-936d-f31a8f1ca53d", "content-length": "26", "date": "Thu, 22 Aug 2024 03:17:52 GMT"} })
26212024-08-22T03:17:53.387ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26222024-08-22T03:17:53.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26232024-08-22T03:17:53.390ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26242024-08-22T03:17:53.390ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2e0c011c-6129-4fe1-8236-d5ea6e330731", "content-length": "372", "date": "Thu, 22 Aug 2024 03:17:52 GMT"} })
26252024-08-22T03:17:53.391ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26262024-08-22T03:17:53.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26272024-08-22T03:17:53.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26282024-08-22T03:17:53.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26292024-08-22T03:17:53.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26302024-08-22T03:17:53.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26312024-08-22T03:17:53.396ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26322024-08-22T03:17:53.398ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "55e042e2-1290-4b6e-809d-a55f4fed57c2", "date": "Thu, 22 Aug 2024 03:17:52 GMT"} })
26332024-08-22T03:17:53.399ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 157.826534ms iteration = 13 status = {}
26342024-08-22T03:17:53.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ee24da45-4458-4289-9902-6b75429e391b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26352024-08-22T03:17:53.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ee24da45-4458-4289-9902-6b75429e391b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26362024-08-22T03:17:53.452ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1653 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ee24da45-4458-4289-9902-6b75429e391b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26372024-08-22T03:17:53.512ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26382024-08-22T03:17:53.512ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e392acff-4762-4e41-86d7-54df73fd1026", "content-length": "1", "date": "Thu, 22 Aug 2024 03:17:52 GMT"} })
26392024-08-22T03:17:53.514ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26402024-08-22T03:17:53.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26412024-08-22T03:17:53.515ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 278.200187ms iteration = 12 status = null
26422024-08-22T03:17:53.535ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
26432024-08-22T03:17:53.535ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26442024-08-22T03:17:53.536ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "201e28e8-db82-4dd5-b49a-2caaf34db24a", "content-length": "26", "date": "Thu, 22 Aug 2024 03:17:52 GMT"} })
26452024-08-22T03:17:53.536ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26462024-08-22T03:17:53.537ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
26472024-08-22T03:17:53.571ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26482024-08-22T03:17:53.572ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3e365948-c555-4d03-be87-2b870ca2c260", "content-length": "691", "date": "Thu, 22 Aug 2024 03:17:52 GMT"} })
26492024-08-22T03:17:53.572ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
26502024-08-22T03:17:53.572ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
26512024-08-22T03:17:53.572ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
26522024-08-22T03:17:53.574ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 333.181689ms iteration = 12 status = {}
26532024-08-22T03:17:53.594ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 356.762216ms iteration = 12 status = {}
26542024-08-22T03:17:53.663ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26552024-08-22T03:17:53.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26562024-08-22T03:17:53.666ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
26572024-08-22T03:17:53.666ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26582024-08-22T03:17:53.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26592024-08-22T03:17:53.673ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26602024-08-22T03:17:53.673ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5e916446-2424-4faf-8aad-466df56c366f", "content-length": "121", "date": "Thu, 22 Aug 2024 03:17:53 GMT"} })
26612024-08-22T03:17:53.673ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
26622024-08-22T03:17:53.673ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
26632024-08-22T03:17:53.673ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26642024-08-22T03:17:53.673ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
26652024-08-22T03:17:53.673ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
26662024-08-22T03:17:53.673ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
26672024-08-22T03:17:53.673ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
26682024-08-22T03:17:53.673ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26692024-08-22T03:17:53.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26702024-08-22T03:17:53.675ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
26712024-08-22T03:17:53.675ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f4c73f4c-0bd8-4806-af72-abccdcfaa0bc", "content-length": "2", "date": "Thu, 22 Aug 2024 03:17:53 GMT"} })
26722024-08-22T03:17:53.675ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
26732024-08-22T03:17:53.675ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9dcd4a79-468f-4857-b3bb-e7348265ac85", "content-length": "51", "date": "Thu, 22 Aug 2024 03:17:53 GMT"} })
26742024-08-22T03:17:53.675ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
26752024-08-22T03:17:53.675ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
26762024-08-22T03:17:53.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = f1116347-7718-4979-b51f-dcad51cf2d5a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
26772024-08-22T03:17:53.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = f1116347-7718-4979-b51f-dcad51cf2d5a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
26782024-08-22T03:17:53.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = f1116347-7718-4979-b51f-dcad51cf2d5a response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
26792024-08-22T03:17:53.763ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5392c31a-4445-47c0-a223-6868669dd168", "date": "Thu, 22 Aug 2024 03:17:53 GMT"} })
26802024-08-22T03:17:53.763ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
26812024-08-22T03:17:53.763ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
26822024-08-22T03:17:53.763ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e627b48f-c21c-4fd6-bfdf-cf9b8d7f31a5", "content-length": "667", "date": "Thu, 22 Aug 2024 03:17:53 GMT"} })
26832024-08-22T03:17:53.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26842024-08-22T03:17:53.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26852024-08-22T03:17:53.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26862024-08-22T03:17:53.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26872024-08-22T03:17:53.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26882024-08-22T03:17:53.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26892024-08-22T03:17:53.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26902024-08-22T03:17:53.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26912024-08-22T03:17:53.779ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 538.388149ms iteration = 12 status = {}
26922024-08-22T03:17:54.443ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1678 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 6941ce22-0384-4b71-8dde-2080e5e839ef response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
26932024-08-22T03:17:54.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = be8cf4f1-98d0-445d-8401-031eba6b1644 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26942024-08-22T03:17:54.472ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = be8cf4f1-98d0-445d-8401-031eba6b1644 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26952024-08-22T03:17:54.474ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = be8cf4f1-98d0-445d-8401-031eba6b1644 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26962024-08-22T03:17:55.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 69526da4-7bbc-47b0-87a0-dac0a9d3773a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26972024-08-22T03:17:55.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 69526da4-7bbc-47b0-87a0-dac0a9d3773a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26982024-08-22T03:17:55.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 69526da4-7bbc-47b0-87a0-dac0a9d3773a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
26992024-08-22T03:17:56.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 52eb1454-5129-4dfe-af2c-8ce9e9c19a06 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27002024-08-22T03:17:56.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 52eb1454-5129-4dfe-af2c-8ce9e9c19a06 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27012024-08-22T03:17:56.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1918 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 52eb1454-5129-4dfe-af2c-8ce9e9c19a06 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27022024-08-22T03:17:57.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aaa63035-1001-4311-8801-6fa4237f6d47 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27032024-08-22T03:17:57.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aaa63035-1001-4311-8801-6fa4237f6d47 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27042024-08-22T03:17:57.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aaa63035-1001-4311-8801-6fa4237f6d47 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27052024-08-22T03:17:58.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a549c30e-881a-457a-83ef-c6a291837cc7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27062024-08-22T03:17:58.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a549c30e-881a-457a-83ef-c6a291837cc7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27072024-08-22T03:17:58.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a549c30e-881a-457a-83ef-c6a291837cc7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27082024-08-22T03:17:59.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 466bcc02-08bb-40b4-a3ea-a2aa22ae6250 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27092024-08-22T03:17:59.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 466bcc02-08bb-40b4-a3ea-a2aa22ae6250 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27102024-08-22T03:17:59.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1846 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 466bcc02-08bb-40b4-a3ea-a2aa22ae6250 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27112024-08-22T03:18:00.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 74e1996d-6e3b-4240-bc2b-c9ed3f041844 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27122024-08-22T03:18:00.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 74e1996d-6e3b-4240-bc2b-c9ed3f041844 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27132024-08-22T03:18:00.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 74e1996d-6e3b-4240-bc2b-c9ed3f041844 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27142024-08-22T03:18:01.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6aeacef4-30d6-4017-bc3f-0c6fbe857acd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27152024-08-22T03:18:01.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6aeacef4-30d6-4017-bc3f-0c6fbe857acd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27162024-08-22T03:18:01.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6aeacef4-30d6-4017-bc3f-0c6fbe857acd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27172024-08-22T03:18:02.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 48be8721-8240-4914-835a-1a6684132ec2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27182024-08-22T03:18:02.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 48be8721-8240-4914-835a-1a6684132ec2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27192024-08-22T03:18:02.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 48be8721-8240-4914-835a-1a6684132ec2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27202024-08-22T03:18:03.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
27212024-08-22T03:18:03.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27222024-08-22T03:18:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27232024-08-22T03:18:03.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27242024-08-22T03:18:03.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
27252024-08-22T03:18:03.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27262024-08-22T03:18:03.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27272024-08-22T03:18:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27282024-08-22T03:18:03.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27292024-08-22T03:18:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27302024-08-22T03:18:03.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27312024-08-22T03:18:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27322024-08-22T03:18:03.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27332024-08-22T03:18:03.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27342024-08-22T03:18:03.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.117739ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27352024-08-22T03:18:03.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27362024-08-22T03:18:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
27372024-08-22T03:18:03.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27382024-08-22T03:18:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27392024-08-22T03:18:03.252ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
27402024-08-22T03:18:03.252ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.675885ms iteration = 35 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
27412024-08-22T03:18:03.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73136818-a612-4db2-9200-043bb37a7ac3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27422024-08-22T03:18:03.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73136818-a612-4db2-9200-043bb37a7ac3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27432024-08-22T03:18:03.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1688 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73136818-a612-4db2-9200-043bb37a7ac3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27442024-08-22T03:18:04.443ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1503 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 32c16c9e-0ea1-4fae-aa9b-bd4b0d660f1b response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
27452024-08-22T03:18:04.443ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
27462024-08-22T03:18:04.443ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
27472024-08-22T03:18:04.474ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
27482024-08-22T03:18:04.475ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:54491
27492024-08-22T03:18:04.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54491 req_id = 95b616be-cc6d-4fbb-a42b-807cf9ee5463 roles = RoleSet { roles: {} } uri = /metrics/producers
27502024-08-22T03:18:04.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54491 req_id = 95b616be-cc6d-4fbb-a42b-807cf9ee5463 resource = Database result = Ok(()) uri = /metrics/producers
27512024-08-22T03:18:04.508ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
27522024-08-22T03:18:04.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54491 req_id = 95b616be-cc6d-4fbb-a42b-807cf9ee5463 roles = RoleSet { roles: {} } uri = /metrics/producers
27532024-08-22T03:18:04.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54491 req_id = 95b616be-cc6d-4fbb-a42b-807cf9ee5463 resource = Database result = Ok(()) uri = /metrics/producers
27542024-08-22T03:18:04.519ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
27552024-08-22T03:18:04.520ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c27809b4-a992-41eb-b53f-9f1945836c3f", "date": "Thu, 22 Aug 2024 03:18:04 GMT"} })
27562024-08-22T03:18:04.520ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
27572024-08-22T03:18:04.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 46048 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:54491 req_id = 95b616be-cc6d-4fbb-a42b-807cf9ee5463 response_code = 201 uri = /metrics/producers
27582024-08-22T03:18:04.521ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "95b616be-cc6d-4fbb-a42b-807cf9ee5463", "content-length": "41", "date": "Thu, 22 Aug 2024 03:18:04 GMT"} })
27592024-08-22T03:18:04.522ZDEBGnexus (producer-registration-task): registered with nexus successfully
27602024-08-22T03:18:04.522ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
27612024-08-22T03:18:04.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d8d725d-1e7a-4f4b-bbe4-0cdb39a08c4a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27622024-08-22T03:18:04.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d8d725d-1e7a-4f4b-bbe4-0cdb39a08c4a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27632024-08-22T03:18:04.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d8d725d-1e7a-4f4b-bbe4-0cdb39a08c4a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27642024-08-22T03:18:05.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4f26ed3e-e7a8-4493-ae0a-d1831b229e22 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27652024-08-22T03:18:05.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4f26ed3e-e7a8-4493-ae0a-d1831b229e22 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27662024-08-22T03:18:05.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4f26ed3e-e7a8-4493-ae0a-d1831b229e22 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27672024-08-22T03:18:06.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cc86192-25b8-4c0f-8770-9cec60e01e5b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27682024-08-22T03:18:06.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cc86192-25b8-4c0f-8770-9cec60e01e5b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27692024-08-22T03:18:06.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cc86192-25b8-4c0f-8770-9cec60e01e5b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27702024-08-22T03:18:07.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aa6914f1-46d6-4dd8-b3e5-ddb84d291863 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27712024-08-22T03:18:07.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aa6914f1-46d6-4dd8-b3e5-ddb84d291863 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27722024-08-22T03:18:07.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aa6914f1-46d6-4dd8-b3e5-ddb84d291863 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27732024-08-22T03:18:08.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 742a3d50-6869-4c76-87e5-580dd1c24760 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27742024-08-22T03:18:08.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 742a3d50-6869-4c76-87e5-580dd1c24760 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27752024-08-22T03:18:08.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 742a3d50-6869-4c76-87e5-580dd1c24760 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27762024-08-22T03:18:09.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 40db591c-528b-44d2-b8b5-f64df5ac1def roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27772024-08-22T03:18:09.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 40db591c-528b-44d2-b8b5-f64df5ac1def resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27782024-08-22T03:18:09.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 40db591c-528b-44d2-b8b5-f64df5ac1def response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27792024-08-22T03:18:10.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2185ab27-96e7-4347-bda5-cf49587dedeb roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27802024-08-22T03:18:10.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2185ab27-96e7-4347-bda5-cf49587dedeb resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27812024-08-22T03:18:10.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2185ab27-96e7-4347-bda5-cf49587dedeb response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27822024-08-22T03:18:11.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 54e7a846-efc9-4451-8dcb-8dd903935373 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27832024-08-22T03:18:11.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 54e7a846-efc9-4451-8dcb-8dd903935373 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27842024-08-22T03:18:11.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 54e7a846-efc9-4451-8dcb-8dd903935373 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27852024-08-22T03:18:12.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cbe4ae4-f54b-42d4-a605-a6ad79f19941 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27862024-08-22T03:18:12.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cbe4ae4-f54b-42d4-a605-a6ad79f19941 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27872024-08-22T03:18:12.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2945 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0cbe4ae4-f54b-42d4-a605-a6ad79f19941 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
27882024-08-22T03:18:13.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
27892024-08-22T03:18:13.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27902024-08-22T03:18:13.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27912024-08-22T03:18:13.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27922024-08-22T03:18:13.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
27932024-08-22T03:18:13.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27942024-08-22T03:18:13.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27952024-08-22T03:18:13.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27962024-08-22T03:18:13.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27972024-08-22T03:18:13.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27982024-08-22T03:18:13.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27992024-08-22T03:18:13.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28002024-08-22T03:18:13.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28012024-08-22T03:18:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28022024-08-22T03:18:13.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.125229ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28032024-08-22T03:18:13.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28042024-08-22T03:18:13.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
28052024-08-22T03:18:13.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28062024-08-22T03:18:13.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28072024-08-22T03:18:13.253ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
28082024-08-22T03:18:13.253ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.253902ms iteration = 36 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
28092024-08-22T03:18:13.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = caa2df0a-957b-4844-9372-9c91c3f69a34 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28102024-08-22T03:18:13.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = caa2df0a-957b-4844-9372-9c91c3f69a34 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28112024-08-22T03:18:13.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = caa2df0a-957b-4844-9372-9c91c3f69a34 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28122024-08-22T03:18:14.523ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 31203cb4-48f6-4065-9d1b-86c8e2613fa8 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
28132024-08-22T03:18:14.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e7cafbc3-5002-4087-a087-59ac7dfeb7c4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28142024-08-22T03:18:14.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e7cafbc3-5002-4087-a087-59ac7dfeb7c4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28152024-08-22T03:18:14.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2562 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e7cafbc3-5002-4087-a087-59ac7dfeb7c4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28162024-08-22T03:18:15.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7e79bf4b-1b4a-4355-899a-db57378b2cca roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28172024-08-22T03:18:15.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7e79bf4b-1b4a-4355-899a-db57378b2cca resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28182024-08-22T03:18:15.925ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7e79bf4b-1b4a-4355-899a-db57378b2cca response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28192024-08-22T03:18:16.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0a60fbbb-562b-41c3-832e-fd37fb475558 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28202024-08-22T03:18:16.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0a60fbbb-562b-41c3-832e-fd37fb475558 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28212024-08-22T03:18:16.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0a60fbbb-562b-41c3-832e-fd37fb475558 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28222024-08-22T03:18:17.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4302849d-ac95-4bf5-ba60-500a6fdf9a1f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28232024-08-22T03:18:17.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4302849d-ac95-4bf5-ba60-500a6fdf9a1f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28242024-08-22T03:18:17.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4302849d-ac95-4bf5-ba60-500a6fdf9a1f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28252024-08-22T03:18:18.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8b717467-1eae-4cb8-8f18-6797a4d8d35f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28262024-08-22T03:18:18.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8b717467-1eae-4cb8-8f18-6797a4d8d35f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28272024-08-22T03:18:18.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8b717467-1eae-4cb8-8f18-6797a4d8d35f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28282024-08-22T03:18:20.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce45979e-232e-41f1-a70d-14ab575994c5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28292024-08-22T03:18:20.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce45979e-232e-41f1-a70d-14ab575994c5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28302024-08-22T03:18:20.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce45979e-232e-41f1-a70d-14ab575994c5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28312024-08-22T03:18:21.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 52f1328b-180c-476d-b831-ab61361869dc roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28322024-08-22T03:18:21.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 52f1328b-180c-476d-b831-ab61361869dc resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28332024-08-22T03:18:21.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 52f1328b-180c-476d-b831-ab61361869dc response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28342024-08-22T03:18:22.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bdc374d1-a550-454e-8bd9-9458c8a56304 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28352024-08-22T03:18:22.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bdc374d1-a550-454e-8bd9-9458c8a56304 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28362024-08-22T03:18:22.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bdc374d1-a550-454e-8bd9-9458c8a56304 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28372024-08-22T03:18:23.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c82dea61-18ec-4acd-b37f-437990827f74 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28382024-08-22T03:18:23.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c82dea61-18ec-4acd-b37f-437990827f74 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28392024-08-22T03:18:23.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c82dea61-18ec-4acd-b37f-437990827f74 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
28402024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
28412024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
28422024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
28432024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
28442024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
28452024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
28462024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
28472024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28482024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
28492024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28502024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
28512024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
28522024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
28532024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
28542024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
28552024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28562024-08-22T03:18:23.238ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-22 03:08:23.238303886 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
28572024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
28582024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
28592024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
28602024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
28612024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
28622024-08-22T03:18:23.238ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = bff907f0-2101-418e-8f5d-955661c8bd6f
28632024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
28642024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.81\u{b5}s iteration = 8 status = {"error":"blueprint disabled","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f"}
28652024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
28662024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
28672024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
28682024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
28692024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
28702024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
28712024-08-22T03:18:23.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28722024-08-22T03:18:23.238ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1467044e-2fe8-4015-be86-a3faa36f1469.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64fff417-46fd-44ed-ac7e-a3829d9efa54.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 758810496 } })
28732024-08-22T03:18:23.239ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3ce7517f-82f9-4849-ad08-7cb0bf67f024.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 759745497 } })
28742024-08-22T03:18:23.239ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
28752024-08-22T03:18:23.239ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
28762024-08-22T03:18:23.239ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28772024-08-22T03:18:23.239ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28782024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28792024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28802024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28812024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28822024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28832024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28842024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28852024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
28862024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
28872024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28882024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
28892024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
28902024-08-22T03:18:23.240ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
28912024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28922024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
28932024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
28942024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28952024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
28962024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28972024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
28982024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28992024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
29002024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
29012024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.705614ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
29022024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
29032024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29042024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29052024-08-22T03:18:23.240ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
29062024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
29072024-08-22T03:18:23.241ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
29082024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29092024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
29102024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
29112024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29122024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29132024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
29142024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29152024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
29162024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
29172024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
29182024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29192024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29202024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29212024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29222024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29232024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29242024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29252024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
29262024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29272024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29282024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29292024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29302024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
29312024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29322024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29332024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29342024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.439443ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29352024-08-22T03:18:23.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362024-08-22T03:18:23.242ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
29372024-08-22T03:18:23.242ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.94364ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
29382024-08-22T03:18:23.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29392024-08-22T03:18:23.242ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29402024-08-22T03:18:23.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
29412024-08-22T03:18:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29422024-08-22T03:18:23.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 763111530 } })
29432024-08-22T03:18:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
29442024-08-22T03:18:23.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 763222221 } })
29452024-08-22T03:18:23.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
29462024-08-22T03:18:23.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
29472024-08-22T03:18:23.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29482024-08-22T03:18:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29492024-08-22T03:18:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29502024-08-22T03:18:23.244ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-22 03:08:23.238303886 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
29512024-08-22T03:18:23.244ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.863024ms iteration = 7 status = {"expiration":"2024-08-22T03:08:23.238303886Z","pruned":[]}
29522024-08-22T03:18:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29532024-08-22T03:18:23.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
29542024-08-22T03:18:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29552024-08-22T03:18:23.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29562024-08-22T03:18:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29572024-08-22T03:18:23.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29582024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29592024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29602024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29612024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
29622024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
29632024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
29642024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
29652024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29662024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
29672024-08-22T03:18:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29682024-08-22T03:18:23.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692024-08-22T03:18:23.246ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29702024-08-22T03:18:23.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29712024-08-22T03:18:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
29722024-08-22T03:18:23.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
29732024-08-22T03:18:23.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29742024-08-22T03:18:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29752024-08-22T03:18:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
29762024-08-22T03:18:23.247ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29772024-08-22T03:18:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
29782024-08-22T03:18:23.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29792024-08-22T03:18:23.248ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
29802024-08-22T03:18:23.248ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
29812024-08-22T03:18:23.248ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
29822024-08-22T03:18:23.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
29832024-08-22T03:18:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
29842024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
29852024-08-22T03:18:23.249ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
29862024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 8.295874ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
29872024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29882024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
29892024-08-22T03:18:23.249ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
29902024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.410946ms iteration = 7 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
29912024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
29922024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29932024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29942024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29952024-08-22T03:18:23.249ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29962024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29972024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29982024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 9.637811ms iteration = 13 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
29992024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30002024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30012024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
30022024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
30032024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
30042024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30052024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30062024-08-22T03:18:23.250ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
30072024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30082024-08-22T03:18:23.250ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30092024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 10.3121ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30102024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30112024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30122024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30132024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30142024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30152024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30162024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30172024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30182024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30192024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30202024-08-22T03:18:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30212024-08-22T03:18:23.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30222024-08-22T03:18:23.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 772247384 } })
30232024-08-22T03:18:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
30242024-08-22T03:18:23.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
30252024-08-22T03:18:23.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30262024-08-22T03:18:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
30272024-08-22T03:18:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30282024-08-22T03:18:23.253ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
30292024-08-22T03:18:23.253ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30302024-08-22T03:18:23.253ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 12.128133ms iteration = 13 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
30312024-08-22T03:18:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
30322024-08-22T03:18:23.253ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30332024-08-22T03:18:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30342024-08-22T03:18:23.253ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
30352024-08-22T03:18:23.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30362024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30372024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30382024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30392024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.275507ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
30402024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30412024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30422024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30432024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30442024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30452024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30462024-08-22T03:18:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30472024-08-22T03:18:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30482024-08-22T03:18:23.255ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30492024-08-22T03:18:23.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 14.482572ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30502024-08-22T03:18:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
30512024-08-22T03:18:23.255ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30522024-08-22T03:18:23.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.575513ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
30532024-08-22T03:18:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30542024-08-22T03:18:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30552024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30562024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30572024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30582024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
30592024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30602024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30612024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
30622024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
30632024-08-22T03:18:23.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30642024-08-22T03:18:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30652024-08-22T03:18:23.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30662024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30672024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30682024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
30692024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30702024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30712024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30722024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30732024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30742024-08-22T03:18:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30752024-08-22T03:18:23.259ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
30762024-08-22T03:18:23.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
30772024-08-22T03:18:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
30782024-08-22T03:18:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
30792024-08-22T03:18:23.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
30802024-08-22T03:18:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
30812024-08-22T03:18:23.263ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30822024-08-22T03:18:23.265ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30832024-08-22T03:18:23.265ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 24.430907ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30842024-08-22T03:18:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
30852024-08-22T03:18:23.265ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
30862024-08-22T03:18:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
30872024-08-22T03:18:23.266ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
30882024-08-22T03:18:23.266ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 0 version = 2
30892024-08-22T03:18:23.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
30902024-08-22T03:18:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
30912024-08-22T03:18:23.266ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 26.585904ms iteration = 16 status = {"physical_disks_added":0}
30922024-08-22T03:18:23.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30932024-08-22T03:18:23.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30942024-08-22T03:18:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30952024-08-22T03:18:23.271ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 31.491866ms iteration = 4 status = {"nsuccess":5}
30962024-08-22T03:18:23.271ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
30972024-08-22T03:18:23.271ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
30982024-08-22T03:18:23.271ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-22 03:13:02.692706 UTC dns_group = internal generation = 1
30992024-08-22T03:18:23.271ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 33.579062ms iteration = 8 status = {"generation":1}
31002024-08-22T03:18:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
31012024-08-22T03:18:23.272ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31022024-08-22T03:18:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31032024-08-22T03:18:23.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31042024-08-22T03:18:23.273ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
31052024-08-22T03:18:23.273ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.349264ms iteration = 37 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
31062024-08-22T03:18:23.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31072024-08-22T03:18:23.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31082024-08-22T03:18:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31092024-08-22T03:18:23.274ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 1 version = 2
31102024-08-22T03:18:23.274ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
31112024-08-22T03:18:23.274ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-22 03:13:03.125979 UTC dns_group = external generation = 2
31122024-08-22T03:18:23.274ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 35.77571ms iteration = 8 status = {"generation":2}
31132024-08-22T03:18:23.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31142024-08-22T03:18:23.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31152024-08-22T03:18:23.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31162024-08-22T03:18:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31172024-08-22T03:18:23.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31182024-08-22T03:18:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31192024-08-22T03:18:23.282ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31202024-08-22T03:18:23.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31212024-08-22T03:18:23.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31222024-08-22T03:18:23.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
31232024-08-22T03:18:23.286ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31242024-08-22T03:18:23.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31252024-08-22T03:18:23.288ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 47.527517ms iteration = 13 status = 0
31262024-08-22T03:18:23.315ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-22T03:12:22.052278Z, time_modified: 2024-08-22T03:12:22.052278Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }) }
31272024-08-22T03:18:23.315ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 77.534715ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]}},"default_endpoint":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
31282024-08-22T03:18:23.424ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
31292024-08-22T03:18:23.429ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
31302024-08-22T03:18:23.429ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31312024-08-22T03:18:23.430ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "32a72bff-499d-41c6-b154-186b75a15b39", "content-length": "26", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} })
31322024-08-22T03:18:23.430ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31332024-08-22T03:18:23.431ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31342024-08-22T03:18:23.432ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
31352024-08-22T03:18:23.488ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31362024-08-22T03:18:23.489ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "347c7dca-b235-4908-865c-e67932538945", "content-length": "691", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} })
31372024-08-22T03:18:23.489ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
31382024-08-22T03:18:23.489ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
31392024-08-22T03:18:23.489ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
31402024-08-22T03:18:23.490ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 250.052443ms iteration = 13 status = {}
31412024-08-22T03:18:23.505ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
31422024-08-22T03:18:23.505ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31432024-08-22T03:18:23.505ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "385646ce-45a0-49ec-bdc6-99fad9f88bf8", "content-length": "26", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} })
31442024-08-22T03:18:23.505ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31452024-08-22T03:18:23.507ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
31462024-08-22T03:18:23.590ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
31472024-08-22T03:18:23.590ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
31482024-08-22T03:18:23.590ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31492024-08-22T03:18:23.591ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8a95d035-b3ff-45a9-9cb6-938070b89f51", "content-length": "26", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} })
31502024-08-22T03:18:23.591ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
31512024-08-22T03:18:23.591ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2fd33104-29f8-4d36-acf0-daabe8034e9a", "content-length": "372", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} })
31522024-08-22T03:18:23.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31532024-08-22T03:18:23.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31542024-08-22T03:18:23.593ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
31552024-08-22T03:18:23.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31562024-08-22T03:18:23.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31572024-08-22T03:18:23.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31582024-08-22T03:18:23.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
31592024-08-22T03:18:23.598ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
31602024-08-22T03:18:23.598ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8ded1d78-f901-4b21-8e2b-fa7a4df59d75", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} })
31612024-08-22T03:18:23.600ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 359.436989ms iteration = 14 status = {}
31622024-08-22T03:18:23.608ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
31632024-08-22T03:18:23.608ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fc81631a-28e6-47bc-b388-e33d05f1e244", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31642024-08-22T03:18:23.608ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31652024-08-22T03:18:23.610ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9bbb572d-7f8a-40e3-9378-9512885d6eb8", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31662024-08-22T03:18:23.610ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31672024-08-22T03:18:23.612ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
31682024-08-22T03:18:23.612ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 373.962092ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
31692024-08-22T03:18:23.633ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
31702024-08-22T03:18:23.634ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "99c6e3bc-c7e7-4ebf-b6a4-352ffdc2bd76", "content-length": "1", "date": "Thu, 22 Aug 2024 03:18:22 GMT"} })
31712024-08-22T03:18:23.636ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31722024-08-22T03:18:23.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31732024-08-22T03:18:23.637ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.508313ms iteration = 13 status = null
31742024-08-22T03:18:23.689ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
31752024-08-22T03:18:23.705ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 467.474287ms iteration = 13 status = {}
31762024-08-22T03:18:23.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = a70edc2a-c945-4065-b069-192b2e2ab501 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
31772024-08-22T03:18:23.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = a70edc2a-c945-4065-b069-192b2e2ab501 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
31782024-08-22T03:18:23.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = a70edc2a-c945-4065-b069-192b2e2ab501 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
31792024-08-22T03:18:23.836ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
31802024-08-22T03:18:23.836ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "274ab642-a620-46aa-8f5d-b07a606dd1d2", "date": "Thu, 22 Aug 2024 03:18:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31812024-08-22T03:18:23.836ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31822024-08-22T03:18:23.838ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bbcef11b-6bce-4015-99f2-f4e4bf783298", "date": "Thu, 22 Aug 2024 03:18:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31832024-08-22T03:18:23.838ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31842024-08-22T03:18:23.840ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "71c24ecb-e7aa-46d0-9e12-c1ac4488ee47", "date": "Thu, 22 Aug 2024 03:18:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31852024-08-22T03:18:23.840ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31862024-08-22T03:18:23.842ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
31872024-08-22T03:18:23.842ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 604.636012ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
31882024-08-22T03:18:23.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31892024-08-22T03:18:23.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31902024-08-22T03:18:23.874ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
31912024-08-22T03:18:23.874ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31922024-08-22T03:18:23.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31932024-08-22T03:18:23.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
31942024-08-22T03:18:23.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "32508c3f-cb01-4581-97e9-d28a5b5aa4b6", "content-length": "121", "date": "Thu, 22 Aug 2024 03:18:23 GMT"} })
31952024-08-22T03:18:23.884ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
31962024-08-22T03:18:23.884ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
31972024-08-22T03:18:23.884ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31982024-08-22T03:18:23.884ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31992024-08-22T03:18:23.884ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
32002024-08-22T03:18:23.884ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
32012024-08-22T03:18:23.884ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
32022024-08-22T03:18:23.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32032024-08-22T03:18:23.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32042024-08-22T03:18:23.886ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
32052024-08-22T03:18:23.886ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6c020dc7-7003-4427-98e5-b64d72cdaeaf", "content-length": "2", "date": "Thu, 22 Aug 2024 03:18:23 GMT"} })
32062024-08-22T03:18:23.886ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
32072024-08-22T03:18:23.886ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "713c8f25-3f38-40a0-a196-0cb6e3a45066", "content-length": "51", "date": "Thu, 22 Aug 2024 03:18:23 GMT"} })
32082024-08-22T03:18:23.886ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
32092024-08-22T03:18:23.886ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
32102024-08-22T03:18:23.974ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b64ea5ac-7100-4540-ad29-3e3f46dfd541", "date": "Thu, 22 Aug 2024 03:18:23 GMT"} })
32112024-08-22T03:18:23.974ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
32122024-08-22T03:18:23.974ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
32132024-08-22T03:18:23.977ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dfefb5b1-ffdc-4c79-9cc5-c3ad90cff8a8", "content-length": "667", "date": "Thu, 22 Aug 2024 03:18:23 GMT"} })
32142024-08-22T03:18:23.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32152024-08-22T03:18:23.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32162024-08-22T03:18:23.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32172024-08-22T03:18:23.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32182024-08-22T03:18:23.984ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32192024-08-22T03:18:23.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32202024-08-22T03:18:23.986ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32212024-08-22T03:18:23.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32222024-08-22T03:18:23.993ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 752.146285ms iteration = 13 status = {}
32232024-08-22T03:18:24.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a96fbe06-f547-4a40-8ff1-d8a97ef6bb3d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32242024-08-22T03:18:24.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a96fbe06-f547-4a40-8ff1-d8a97ef6bb3d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32252024-08-22T03:18:24.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a96fbe06-f547-4a40-8ff1-d8a97ef6bb3d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32262024-08-22T03:18:24.523ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1717 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 45924a32-b974-41ec-a6c6-316a6af65608 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
32272024-08-22T03:18:25.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2b5c8a13-bcf2-4849-8047-1acedb810b36 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32282024-08-22T03:18:25.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2b5c8a13-bcf2-4849-8047-1acedb810b36 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32292024-08-22T03:18:25.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2b5c8a13-bcf2-4849-8047-1acedb810b36 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32302024-08-22T03:18:26.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fd6a1a3c-76ed-47d6-af29-926978c2b6f9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32312024-08-22T03:18:26.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fd6a1a3c-76ed-47d6-af29-926978c2b6f9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32322024-08-22T03:18:26.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fd6a1a3c-76ed-47d6-af29-926978c2b6f9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32332024-08-22T03:18:27.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b12499f2-d2f2-4bc8-b718-110d52fffcbc roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32342024-08-22T03:18:27.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b12499f2-d2f2-4bc8-b718-110d52fffcbc resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32352024-08-22T03:18:27.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2341 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b12499f2-d2f2-4bc8-b718-110d52fffcbc response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32362024-08-22T03:18:28.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 53ad536e-b038-42fd-8d5b-c63cd10e913f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32372024-08-22T03:18:28.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 53ad536e-b038-42fd-8d5b-c63cd10e913f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32382024-08-22T03:18:28.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1881 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 53ad536e-b038-42fd-8d5b-c63cd10e913f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32392024-08-22T03:18:29.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db92a5f7-083d-4466-acc2-fd0893427471 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32402024-08-22T03:18:29.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db92a5f7-083d-4466-acc2-fd0893427471 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32412024-08-22T03:18:29.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db92a5f7-083d-4466-acc2-fd0893427471 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32422024-08-22T03:18:30.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4175d377-c60d-4521-b74a-61e98244c854 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32432024-08-22T03:18:30.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4175d377-c60d-4521-b74a-61e98244c854 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32442024-08-22T03:18:30.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4175d377-c60d-4521-b74a-61e98244c854 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32452024-08-22T03:18:31.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f1571ee9-7958-45d6-a2a3-a85fbfea6b4f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32462024-08-22T03:18:31.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f1571ee9-7958-45d6-a2a3-a85fbfea6b4f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32472024-08-22T03:18:31.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f1571ee9-7958-45d6-a2a3-a85fbfea6b4f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32482024-08-22T03:18:32.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c1cc9ba-985e-4864-b48a-bfeb7bae22c4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32492024-08-22T03:18:32.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c1cc9ba-985e-4864-b48a-bfeb7bae22c4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32502024-08-22T03:18:32.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c1cc9ba-985e-4864-b48a-bfeb7bae22c4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32512024-08-22T03:18:33.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
32522024-08-22T03:18:33.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32532024-08-22T03:18:33.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32542024-08-22T03:18:33.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32552024-08-22T03:18:33.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
32562024-08-22T03:18:33.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32572024-08-22T03:18:33.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32582024-08-22T03:18:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32592024-08-22T03:18:33.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32602024-08-22T03:18:33.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32612024-08-22T03:18:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32622024-08-22T03:18:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32632024-08-22T03:18:33.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32642024-08-22T03:18:33.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.994378ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32652024-08-22T03:18:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32662024-08-22T03:18:33.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32672024-08-22T03:18:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
32682024-08-22T03:18:33.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32692024-08-22T03:18:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32702024-08-22T03:18:33.253ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
32712024-08-22T03:18:33.253ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.974788ms iteration = 38 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
32722024-08-22T03:18:33.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7b8fbc1-aa99-4f7a-8348-76f75b03a5ab roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32732024-08-22T03:18:33.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7b8fbc1-aa99-4f7a-8348-76f75b03a5ab resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32742024-08-22T03:18:33.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7b8fbc1-aa99-4f7a-8348-76f75b03a5ab response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32752024-08-22T03:18:34.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 41fbaabc-d3a3-43d1-978d-ab90292fd5a7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32762024-08-22T03:18:34.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 41fbaabc-d3a3-43d1-978d-ab90292fd5a7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32772024-08-22T03:18:34.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1819 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 41fbaabc-d3a3-43d1-978d-ab90292fd5a7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32782024-08-22T03:18:34.523ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1542 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 46b0635f-c8cc-459c-aacc-51c12ca7fad7 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
32792024-08-22T03:18:35.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2bd10306-525c-49d1-a533-cf0159a5f9cf roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32802024-08-22T03:18:35.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2bd10306-525c-49d1-a533-cf0159a5f9cf resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32812024-08-22T03:18:35.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2bd10306-525c-49d1-a533-cf0159a5f9cf response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32822024-08-22T03:18:36.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b0bda87f-668d-4bd3-a93f-2ccdcb63f526 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32832024-08-22T03:18:36.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b0bda87f-668d-4bd3-a93f-2ccdcb63f526 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32842024-08-22T03:18:36.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b0bda87f-668d-4bd3-a93f-2ccdcb63f526 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32852024-08-22T03:18:37.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1422c227-0673-4d68-b169-b80ffa4969b2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32862024-08-22T03:18:37.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1422c227-0673-4d68-b169-b80ffa4969b2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32872024-08-22T03:18:37.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1422c227-0673-4d68-b169-b80ffa4969b2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32882024-08-22T03:18:38.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f2df5174-da63-44c8-8877-5b5b0a27ed2b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32892024-08-22T03:18:38.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f2df5174-da63-44c8-8877-5b5b0a27ed2b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32902024-08-22T03:18:38.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f2df5174-da63-44c8-8877-5b5b0a27ed2b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32912024-08-22T03:18:39.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8a42140c-3783-41d6-9455-552cc4f1ed72 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32922024-08-22T03:18:39.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8a42140c-3783-41d6-9455-552cc4f1ed72 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32932024-08-22T03:18:39.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8a42140c-3783-41d6-9455-552cc4f1ed72 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32942024-08-22T03:18:40.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0b7a0dad-cec4-4761-a72d-9d5d9fa8a391 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32952024-08-22T03:18:40.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0b7a0dad-cec4-4761-a72d-9d5d9fa8a391 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32962024-08-22T03:18:40.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0b7a0dad-cec4-4761-a72d-9d5d9fa8a391 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32972024-08-22T03:18:41.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 353077e0-5d8e-4c05-b224-d4b87abecaf6 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32982024-08-22T03:18:41.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 353077e0-5d8e-4c05-b224-d4b87abecaf6 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
32992024-08-22T03:18:41.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 353077e0-5d8e-4c05-b224-d4b87abecaf6 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33002024-08-22T03:18:42.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e680f5b-55bd-4b95-9050-5d9fb8b3fa03 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33012024-08-22T03:18:42.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e680f5b-55bd-4b95-9050-5d9fb8b3fa03 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33022024-08-22T03:18:42.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e680f5b-55bd-4b95-9050-5d9fb8b3fa03 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33032024-08-22T03:18:43.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
33042024-08-22T03:18:43.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33052024-08-22T03:18:43.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33062024-08-22T03:18:43.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33072024-08-22T03:18:43.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
33082024-08-22T03:18:43.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33092024-08-22T03:18:43.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33102024-08-22T03:18:43.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
33112024-08-22T03:18:43.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33122024-08-22T03:18:43.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33132024-08-22T03:18:43.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33142024-08-22T03:18:43.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33152024-08-22T03:18:43.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33162024-08-22T03:18:43.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.974808ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
33172024-08-22T03:18:43.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33182024-08-22T03:18:43.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33192024-08-22T03:18:43.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
33202024-08-22T03:18:43.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33212024-08-22T03:18:43.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33222024-08-22T03:18:43.253ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
33232024-08-22T03:18:43.253ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.085499ms iteration = 39 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
33242024-08-22T03:18:43.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8585074a-9f31-43e4-912d-80822779ab0f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33252024-08-22T03:18:43.497ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8585074a-9f31-43e4-912d-80822779ab0f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33262024-08-22T03:18:43.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8585074a-9f31-43e4-912d-80822779ab0f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33272024-08-22T03:18:44.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 27b098e6-a113-4bdd-a640-0682df0d44d8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33282024-08-22T03:18:44.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 27b098e6-a113-4bdd-a640-0682df0d44d8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33292024-08-22T03:18:44.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2421 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 27b098e6-a113-4bdd-a640-0682df0d44d8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33302024-08-22T03:18:44.524ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1358 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = d063bc5f-af0d-4abc-8c30-9d2af74a9a29 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
33312024-08-22T03:18:45.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8cb1dbbd-bd29-4a95-b3f0-1a8c78ded355 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33322024-08-22T03:18:45.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8cb1dbbd-bd29-4a95-b3f0-1a8c78ded355 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33332024-08-22T03:18:45.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8cb1dbbd-bd29-4a95-b3f0-1a8c78ded355 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33342024-08-22T03:18:46.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 410bc4dc-7b71-4e66-9241-a9f70a705669 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33352024-08-22T03:18:46.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 410bc4dc-7b71-4e66-9241-a9f70a705669 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33362024-08-22T03:18:46.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 410bc4dc-7b71-4e66-9241-a9f70a705669 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33372024-08-22T03:18:47.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4764257e-0020-4500-9c02-67c6dd85ebd1 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33382024-08-22T03:18:47.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4764257e-0020-4500-9c02-67c6dd85ebd1 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33392024-08-22T03:18:47.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4764257e-0020-4500-9c02-67c6dd85ebd1 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33402024-08-22T03:18:48.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8ec816cd-5e7e-4b68-a9af-bac185e0844b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33412024-08-22T03:18:48.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8ec816cd-5e7e-4b68-a9af-bac185e0844b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33422024-08-22T03:18:48.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8ec816cd-5e7e-4b68-a9af-bac185e0844b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33432024-08-22T03:18:49.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 90d7c716-ed8f-4398-9124-10b07e3eba86 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33442024-08-22T03:18:49.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 90d7c716-ed8f-4398-9124-10b07e3eba86 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33452024-08-22T03:18:49.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 90d7c716-ed8f-4398-9124-10b07e3eba86 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33462024-08-22T03:18:50.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aad74911-2a4c-4c85-8565-9d78eafb3d9c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33472024-08-22T03:18:50.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aad74911-2a4c-4c85-8565-9d78eafb3d9c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33482024-08-22T03:18:50.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aad74911-2a4c-4c85-8565-9d78eafb3d9c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33492024-08-22T03:18:51.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bb7e260c-a259-4140-bb72-166141d13b5e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33502024-08-22T03:18:51.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bb7e260c-a259-4140-bb72-166141d13b5e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33512024-08-22T03:18:51.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2660 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bb7e260c-a259-4140-bb72-166141d13b5e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33522024-08-22T03:18:52.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9572fa7e-243e-4389-9149-f952b66563f6 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33532024-08-22T03:18:52.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9572fa7e-243e-4389-9149-f952b66563f6 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33542024-08-22T03:18:52.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1721 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9572fa7e-243e-4389-9149-f952b66563f6 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
33552024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
33562024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
33572024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33582024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
33592024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
33602024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
33612024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
33622024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33632024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33642024-08-22T03:18:53.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33652024-08-22T03:18:53.240ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
33662024-08-22T03:18:53.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33672024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33682024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33692024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
33702024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
33712024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33722024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33732024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
33742024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33752024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
33762024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
33772024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
33782024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33792024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
33802024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33812024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33822024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
33832024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
33842024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
33852024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33862024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
33872024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33882024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
33892024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33902024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33912024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33922024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.502561ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33932024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33942024-08-22T03:18:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33952024-08-22T03:18:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33962024-08-22T03:18:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33972024-08-22T03:18:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33982024-08-22T03:18:53.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 761286443 } })
33992024-08-22T03:18:53.242ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 761310303 } })
34002024-08-22T03:18:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34012024-08-22T03:18:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34022024-08-22T03:18:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34032024-08-22T03:18:53.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34042024-08-22T03:18:53.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34052024-08-22T03:18:53.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
34062024-08-22T03:18:53.242ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
34072024-08-22T03:18:53.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 1.821503ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
34082024-08-22T03:18:53.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34092024-08-22T03:18:53.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34102024-08-22T03:18:53.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112024-08-22T03:18:53.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34122024-08-22T03:18:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34132024-08-22T03:18:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34142024-08-22T03:18:53.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34152024-08-22T03:18:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34162024-08-22T03:18:53.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34172024-08-22T03:18:53.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34182024-08-22T03:18:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34192024-08-22T03:18:53.245ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
34202024-08-22T03:18:53.245ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34212024-08-22T03:18:53.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34222024-08-22T03:18:53.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.477367ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34232024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34242024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34252024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34262024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34272024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34282024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34292024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34312024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34322024-08-22T03:18:53.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34332024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34342024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34352024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34362024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34372024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34382024-08-22T03:18:53.247ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
34392024-08-22T03:18:53.247ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
34402024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 6.129977ms iteration = 14 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
34412024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.222718ms iteration = 14 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
34422024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34432024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34442024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34452024-08-22T03:18:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34462024-08-22T03:18:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34472024-08-22T03:18:53.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34482024-08-22T03:18:53.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34492024-08-22T03:18:53.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34502024-08-22T03:18:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34512024-08-22T03:18:53.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522024-08-22T03:18:53.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 768322501 } })
34532024-08-22T03:18:53.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34542024-08-22T03:18:53.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
34552024-08-22T03:18:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34562024-08-22T03:18:53.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34572024-08-22T03:18:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34582024-08-22T03:18:53.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34592024-08-22T03:18:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34602024-08-22T03:18:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34612024-08-22T03:18:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
34622024-08-22T03:18:53.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34632024-08-22T03:18:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34642024-08-22T03:18:53.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 10.872407ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
34652024-08-22T03:18:53.252ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
34662024-08-22T03:18:53.252ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 11.08851ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
34672024-08-22T03:18:53.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34682024-08-22T03:18:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34692024-08-22T03:18:53.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
34702024-08-22T03:18:53.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.019487ms iteration = 40 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
34712024-08-22T03:18:53.258ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 17.319357ms iteration = 17 status = {"physical_disks_added":0}
34722024-08-22T03:18:53.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34732024-08-22T03:18:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34742024-08-22T03:18:53.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34752024-08-22T03:18:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34762024-08-22T03:18:53.261ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34772024-08-22T03:18:53.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34782024-08-22T03:18:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34792024-08-22T03:18:53.262ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34802024-08-22T03:18:53.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34812024-08-22T03:18:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34822024-08-22T03:18:53.263ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34832024-08-22T03:18:53.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34842024-08-22T03:18:53.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
34852024-08-22T03:18:53.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34862024-08-22T03:18:53.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34872024-08-22T03:18:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
34882024-08-22T03:18:53.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34892024-08-22T03:18:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34902024-08-22T03:18:53.266ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 24.802382ms iteration = 14 status = 0
34912024-08-22T03:18:53.388ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
34922024-08-22T03:18:53.388ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34932024-08-22T03:18:53.389ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "27720554-e030-44d1-b86e-410da6b289ec", "content-length": "26", "date": "Thu, 22 Aug 2024 03:18:52 GMT"} })
34942024-08-22T03:18:53.389ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34952024-08-22T03:18:53.390ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34962024-08-22T03:18:53.402ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
34972024-08-22T03:18:53.402ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34982024-08-22T03:18:53.402ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f2b43ba8-bc70-4289-ac60-4b17aa72d608", "content-length": "26", "date": "Thu, 22 Aug 2024 03:18:52 GMT"} })
34992024-08-22T03:18:53.402ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35002024-08-22T03:18:53.403ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
35012024-08-22T03:18:53.410ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
35022024-08-22T03:18:53.411ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "006bc4dd-9008-46db-a897-93f3995e9985", "content-length": "691", "date": "Thu, 22 Aug 2024 03:18:52 GMT"} })
35032024-08-22T03:18:53.411ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
35042024-08-22T03:18:53.411ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
35052024-08-22T03:18:53.411ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
35062024-08-22T03:18:53.412ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 171.086241ms iteration = 14 status = {}
35072024-08-22T03:18:53.486ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
35082024-08-22T03:18:53.486ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35092024-08-22T03:18:53.487ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0485f14b-5923-48e8-a490-092febf983bb", "content-length": "26", "date": "Thu, 22 Aug 2024 03:18:52 GMT"} })
35102024-08-22T03:18:53.487ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35112024-08-22T03:18:53.490ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35122024-08-22T03:18:53.507ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35132024-08-22T03:18:53.507ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "88dd308b-ab7a-48ae-9df4-360a8acd6039", "content-length": "372", "date": "Thu, 22 Aug 2024 03:18:52 GMT"} })
35142024-08-22T03:18:53.507ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35152024-08-22T03:18:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35162024-08-22T03:18:53.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35172024-08-22T03:18:53.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35182024-08-22T03:18:53.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35192024-08-22T03:18:53.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35202024-08-22T03:18:53.512ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35212024-08-22T03:18:53.513ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6c91acf9-4c60-4cd6-a7af-aaac893abd3d", "date": "Thu, 22 Aug 2024 03:18:52 GMT"} })
35222024-08-22T03:18:53.514ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 272.741109ms iteration = 15 status = {}
35232024-08-22T03:18:53.518ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35242024-08-22T03:18:53.518ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e827c61f-af82-4a1f-a88d-53c9bf0114c4", "content-length": "1", "date": "Thu, 22 Aug 2024 03:18:53 GMT"} })
35252024-08-22T03:18:53.520ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35262024-08-22T03:18:53.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35272024-08-22T03:18:53.521ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 282.480091ms iteration = 14 status = null
35282024-08-22T03:18:53.565ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.417584ms iteration = 14 status = {}
35292024-08-22T03:18:53.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35302024-08-22T03:18:53.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35312024-08-22T03:18:53.606ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
35322024-08-22T03:18:53.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35332024-08-22T03:18:53.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35342024-08-22T03:18:53.611ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
35352024-08-22T03:18:53.612ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d03ad7b0-c231-4aac-b3b0-3848742e88fb", "content-length": "121", "date": "Thu, 22 Aug 2024 03:18:53 GMT"} })
35362024-08-22T03:18:53.612ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
35372024-08-22T03:18:53.612ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
35382024-08-22T03:18:53.612ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35392024-08-22T03:18:53.612ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
35402024-08-22T03:18:53.612ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
35412024-08-22T03:18:53.612ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
35422024-08-22T03:18:53.612ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
35432024-08-22T03:18:53.612ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35442024-08-22T03:18:53.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35452024-08-22T03:18:53.613ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
35462024-08-22T03:18:53.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a618e65e-047a-4b22-880e-1384cee27ab3", "content-length": "2", "date": "Thu, 22 Aug 2024 03:18:53 GMT"} })
35472024-08-22T03:18:53.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35482024-08-22T03:18:53.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "18d13c56-f86b-4147-a3bb-285a86d33de3", "content-length": "51", "date": "Thu, 22 Aug 2024 03:18:53 GMT"} })
35492024-08-22T03:18:53.614ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
35502024-08-22T03:18:53.614ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35512024-08-22T03:18:53.704ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "247e5557-98c7-42a6-8d05-e8bbc93ad1d5", "date": "Thu, 22 Aug 2024 03:18:53 GMT"} })
35522024-08-22T03:18:53.704ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
35532024-08-22T03:18:53.704ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35542024-08-22T03:18:53.704ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "78dcec33-2f77-4cc5-ac77-68f2cfdead3e", "content-length": "667", "date": "Thu, 22 Aug 2024 03:18:53 GMT"} })
35552024-08-22T03:18:53.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35562024-08-22T03:18:53.705ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35572024-08-22T03:18:53.709ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35582024-08-22T03:18:53.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35592024-08-22T03:18:53.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 05285193-ebb2-4a69-b446-33d2318b4fa8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35602024-08-22T03:18:53.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 05285193-ebb2-4a69-b446-33d2318b4fa8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35612024-08-22T03:18:53.713ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35622024-08-22T03:18:53.713ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35632024-08-22T03:18:53.713ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 05285193-ebb2-4a69-b446-33d2318b4fa8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35642024-08-22T03:18:53.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35652024-08-22T03:18:53.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35662024-08-22T03:18:53.722ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 481.228269ms iteration = 14 status = {}
35672024-08-22T03:18:53.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = b25fcf85-44dd-4c25-9cd5-4c2e49a7933a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
35682024-08-22T03:18:53.806ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = b25fcf85-44dd-4c25-9cd5-4c2e49a7933a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
35692024-08-22T03:18:53.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3063 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = b25fcf85-44dd-4c25-9cd5-4c2e49a7933a response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
35702024-08-22T03:18:54.524ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1519 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = d2be5134-fd8b-40ad-b6a8-55796a35c780 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
35712024-08-22T03:18:54.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 918e67c0-32f1-4ac6-ae7b-ab26e81d7fc0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35722024-08-22T03:18:54.732ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 918e67c0-32f1-4ac6-ae7b-ab26e81d7fc0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35732024-08-22T03:18:54.734ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2232 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 918e67c0-32f1-4ac6-ae7b-ab26e81d7fc0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35742024-08-22T03:18:55.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce8025c7-e467-42e3-83d7-13a750ebba8c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35752024-08-22T03:18:55.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce8025c7-e467-42e3-83d7-13a750ebba8c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35762024-08-22T03:18:55.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ce8025c7-e467-42e3-83d7-13a750ebba8c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35772024-08-22T03:18:56.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d73fd179-89ae-4529-86e7-8c663f8b46fb roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35782024-08-22T03:18:56.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d73fd179-89ae-4529-86e7-8c663f8b46fb resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35792024-08-22T03:18:56.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d73fd179-89ae-4529-86e7-8c663f8b46fb response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35802024-08-22T03:18:57.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c0274493-e0be-4d45-8e2e-502bf268116b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35812024-08-22T03:18:57.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c0274493-e0be-4d45-8e2e-502bf268116b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35822024-08-22T03:18:57.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c0274493-e0be-4d45-8e2e-502bf268116b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35832024-08-22T03:18:58.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aba7586a-c1e3-4109-9b6d-4a281c978e9a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35842024-08-22T03:18:58.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aba7586a-c1e3-4109-9b6d-4a281c978e9a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35852024-08-22T03:18:58.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = aba7586a-c1e3-4109-9b6d-4a281c978e9a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35862024-08-22T03:18:59.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f10c35f9-4462-4e2f-8f0f-a8305668998e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35872024-08-22T03:18:59.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f10c35f9-4462-4e2f-8f0f-a8305668998e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35882024-08-22T03:18:59.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f10c35f9-4462-4e2f-8f0f-a8305668998e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35892024-08-22T03:19:00.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b51b5604-a759-4829-93b1-26616892381b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35902024-08-22T03:19:00.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b51b5604-a759-4829-93b1-26616892381b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35912024-08-22T03:19:00.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b51b5604-a759-4829-93b1-26616892381b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35922024-08-22T03:19:01.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e8ec03c-2655-42cd-a39d-64d704be22b1 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35932024-08-22T03:19:01.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e8ec03c-2655-42cd-a39d-64d704be22b1 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35942024-08-22T03:19:01.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e8ec03c-2655-42cd-a39d-64d704be22b1 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35952024-08-22T03:19:02.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df659859-15ed-4101-809b-2f274a59cea9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35962024-08-22T03:19:02.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df659859-15ed-4101-809b-2f274a59cea9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35972024-08-22T03:19:02.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df659859-15ed-4101-809b-2f274a59cea9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
35982024-08-22T03:19:03.238ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
35992024-08-22T03:19:03.238ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36002024-08-22T03:19:03.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36012024-08-22T03:19:03.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36022024-08-22T03:19:03.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
36032024-08-22T03:19:03.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36042024-08-22T03:19:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36052024-08-22T03:19:03.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36062024-08-22T03:19:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36072024-08-22T03:19:03.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36082024-08-22T03:19:03.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36092024-08-22T03:19:03.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36102024-08-22T03:19:03.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36112024-08-22T03:19:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36122024-08-22T03:19:03.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.889977ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36132024-08-22T03:19:03.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36142024-08-22T03:19:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
36152024-08-22T03:19:03.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36162024-08-22T03:19:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36172024-08-22T03:19:03.254ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
36182024-08-22T03:19:03.254ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.496995ms iteration = 41 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
36192024-08-22T03:19:03.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a0e4872-209d-4fbc-bcb1-63e4187ef61c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36202024-08-22T03:19:03.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a0e4872-209d-4fbc-bcb1-63e4187ef61c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36212024-08-22T03:19:03.932ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1790 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a0e4872-209d-4fbc-bcb1-63e4187ef61c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36222024-08-22T03:19:04.524ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1582 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 0bd0b283-ba19-4c31-aaf0-39efd49305f4 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
36232024-08-22T03:19:04.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d21e2c1-147f-41b1-85fe-4667c2e12d57 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36242024-08-22T03:19:04.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d21e2c1-147f-41b1-85fe-4667c2e12d57 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36252024-08-22T03:19:04.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8d21e2c1-147f-41b1-85fe-4667c2e12d57 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36262024-08-22T03:19:05.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 004ab234-8ce9-4bbe-bf5a-5c3e48d2aa5b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36272024-08-22T03:19:05.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 004ab234-8ce9-4bbe-bf5a-5c3e48d2aa5b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36282024-08-22T03:19:05.977ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 004ab234-8ce9-4bbe-bf5a-5c3e48d2aa5b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36292024-08-22T03:19:06.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6175e865-fca3-465a-95ef-d4d101e344ca roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36302024-08-22T03:19:06.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6175e865-fca3-465a-95ef-d4d101e344ca resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36312024-08-22T03:19:06.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6175e865-fca3-465a-95ef-d4d101e344ca response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36322024-08-22T03:19:08.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 538e1121-439a-4ba1-89bb-a87f9d535b70 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36332024-08-22T03:19:08.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 538e1121-439a-4ba1-89bb-a87f9d535b70 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36342024-08-22T03:19:08.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 538e1121-439a-4ba1-89bb-a87f9d535b70 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36352024-08-22T03:19:08.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 31c2034f-05c1-40e4-959a-5b3ab4be2178 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
36362024-08-22T03:19:08.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 31c2034f-05c1-40e4-959a-5b3ab4be2178 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
36372024-08-22T03:19:08.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3075 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 31c2034f-05c1-40e4-959a-5b3ab4be2178 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
36382024-08-22T03:19:08.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 69e5f56f-950e-4867-8022-e239d4f181aa roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
36392024-08-22T03:19:08.830ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 69e5f56f-950e-4867-8022-e239d4f181aa resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
36402024-08-22T03:19:08.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 69e5f56f-950e-4867-8022-e239d4f181aa response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
36412024-08-22T03:19:09.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9c15ef41-3e29-46cd-b555-79f5e9531273 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36422024-08-22T03:19:09.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9c15ef41-3e29-46cd-b555-79f5e9531273 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36432024-08-22T03:19:09.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9c15ef41-3e29-46cd-b555-79f5e9531273 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36442024-08-22T03:19:10.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 944e61d9-6d38-484e-825e-aa4ab1529fb3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36452024-08-22T03:19:10.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 944e61d9-6d38-484e-825e-aa4ab1529fb3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36462024-08-22T03:19:10.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 944e61d9-6d38-484e-825e-aa4ab1529fb3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36472024-08-22T03:19:11.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4c376f26-cf5c-464c-9ca8-1d87aaf33d68 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36482024-08-22T03:19:11.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4c376f26-cf5c-464c-9ca8-1d87aaf33d68 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36492024-08-22T03:19:11.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4c376f26-cf5c-464c-9ca8-1d87aaf33d68 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36502024-08-22T03:19:12.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ce892fd-5ecd-48fc-9e87-74d9af7c18d6 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36512024-08-22T03:19:12.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ce892fd-5ecd-48fc-9e87-74d9af7c18d6 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36522024-08-22T03:19:12.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ce892fd-5ecd-48fc-9e87-74d9af7c18d6 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36532024-08-22T03:19:13.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bd9049ed-10dd-4afe-9bcf-04ae29337d4c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36542024-08-22T03:19:13.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bd9049ed-10dd-4afe-9bcf-04ae29337d4c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36552024-08-22T03:19:13.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2045 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bd9049ed-10dd-4afe-9bcf-04ae29337d4c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36562024-08-22T03:19:13.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
36572024-08-22T03:19:13.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36582024-08-22T03:19:13.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36592024-08-22T03:19:13.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36602024-08-22T03:19:13.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
36612024-08-22T03:19:13.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36622024-08-22T03:19:13.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36632024-08-22T03:19:13.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36642024-08-22T03:19:13.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36652024-08-22T03:19:13.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36662024-08-22T03:19:13.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36672024-08-22T03:19:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36682024-08-22T03:19:13.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36692024-08-22T03:19:13.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36702024-08-22T03:19:13.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.477313ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36712024-08-22T03:19:13.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36722024-08-22T03:19:13.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
36732024-08-22T03:19:13.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36742024-08-22T03:19:13.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36752024-08-22T03:19:13.253ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
36762024-08-22T03:19:13.253ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 13.952385ms iteration = 42 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
36772024-08-22T03:19:14.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 88f09091-c478-45ea-b461-2d67de968a51 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36782024-08-22T03:19:14.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 88f09091-c478-45ea-b461-2d67de968a51 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36792024-08-22T03:19:14.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 88f09091-c478-45ea-b461-2d67de968a51 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36802024-08-22T03:19:14.524ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1571 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 31d539ef-0d5c-4c17-bbc1-74336fc42e7f response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
36812024-08-22T03:19:15.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4fca884b-8e99-4c84-8f8f-98cd91e4536c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36822024-08-22T03:19:15.178ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4fca884b-8e99-4c84-8f8f-98cd91e4536c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36832024-08-22T03:19:15.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2361 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4fca884b-8e99-4c84-8f8f-98cd91e4536c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36842024-08-22T03:19:16.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e71df446-3346-4ed8-8370-2649e3e31e49 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36852024-08-22T03:19:16.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e71df446-3346-4ed8-8370-2649e3e31e49 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36862024-08-22T03:19:16.209ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e71df446-3346-4ed8-8370-2649e3e31e49 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
36872024-08-22T03:19:16.366ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c8dfade-1f78-48e1-a75e-153f9bad0f2c uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-08-22T03:19:16.349839155Z }
36882024-08-22T03:19:16.366ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c8dfade-1f78-48e1-a75e-153f9bad0f2c roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
36892024-08-22T03:19:16.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c8dfade-1f78-48e1-a75e-153f9bad0f2c resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
36902024-08-22T03:19:16.386ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1:0]:63882
36912024-08-22T03:19:16.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63882 req_id = 384f6045-adf7-4198-a081-2bac9024ff2c roles = RoleSet { roles: {} } uri = /metrics/producers
36922024-08-22T03:19:16.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63882 req_id = 384f6045-adf7-4198-a081-2bac9024ff2c resource = Database result = Ok(()) uri = /metrics/producers
36932024-08-22T03:19:16.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 49772 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c8dfade-1f78-48e1-a75e-153f9bad0f2c response_code = 204 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
36942024-08-22T03:19:16.400ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fe202360-7214-447a-b4ab-8fcf6f51ffa8 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-22T03:19:16.400755755Z }
36952024-08-22T03:19:16.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fe202360-7214-447a-b4ab-8fcf6f51ffa8 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
36962024-08-22T03:19:16.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fe202360-7214-447a-b4ab-8fcf6f51ffa8 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
36972024-08-22T03:19:16.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 10980 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fe202360-7214-447a-b4ab-8fcf6f51ffa8 response_code = 204 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
36982024-08-22T03:19:16.420ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
36992024-08-22T03:19:16.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63882 req_id = 384f6045-adf7-4198-a081-2bac9024ff2c roles = RoleSet { roles: {} } uri = /metrics/producers
37002024-08-22T03:19:16.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63882 req_id = 384f6045-adf7-4198-a081-2bac9024ff2c resource = Database result = Ok(()) uri = /metrics/producers
37012024-08-22T03:19:16.465ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
37022024-08-22T03:19:16.465ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "c430c0ec-4764-4e06-8b21-2701bcb12448", "date": "Thu, 22 Aug 2024 03:19:16 GMT"} })
37032024-08-22T03:19:16.465ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509
37042024-08-22T03:19:16.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 80064 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63882 req_id = 384f6045-adf7-4198-a081-2bac9024ff2c response_code = 201 uri = /metrics/producers
37052024-08-22T03:19:17.229ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c7435c5-c3d9-4260-bf50-dd19fb14658a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37062024-08-22T03:19:17.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c7435c5-c3d9-4260-bf50-dd19fb14658a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37072024-08-22T03:19:17.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2574 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c7435c5-c3d9-4260-bf50-dd19fb14658a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37082024-08-22T03:19:18.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f7511d32-02a5-4d81-b136-acf37c1ab78d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37092024-08-22T03:19:18.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f7511d32-02a5-4d81-b136-acf37c1ab78d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37102024-08-22T03:19:18.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f7511d32-02a5-4d81-b136-acf37c1ab78d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37112024-08-22T03:19:19.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ea9feb39-8f66-4a81-b849-95461b3ce0ad roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37122024-08-22T03:19:19.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ea9feb39-8f66-4a81-b849-95461b3ce0ad resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37132024-08-22T03:19:19.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2370 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ea9feb39-8f66-4a81-b849-95461b3ce0ad response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37142024-08-22T03:19:20.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2439516a-7a2f-4f9e-bf1b-a29ae969cd43 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37152024-08-22T03:19:20.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2439516a-7a2f-4f9e-bf1b-a29ae969cd43 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37162024-08-22T03:19:20.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2439516a-7a2f-4f9e-bf1b-a29ae969cd43 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37172024-08-22T03:19:21.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6045ee0d-30b8-4621-bdf6-5d60396a0b76 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37182024-08-22T03:19:21.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6045ee0d-30b8-4621-bdf6-5d60396a0b76 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37192024-08-22T03:19:21.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6045ee0d-30b8-4621-bdf6-5d60396a0b76 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37202024-08-22T03:19:22.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 30b2007e-5516-4f7b-92ae-5c00ae808f35 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37212024-08-22T03:19:22.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 30b2007e-5516-4f7b-92ae-5c00ae808f35 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37222024-08-22T03:19:22.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2461 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 30b2007e-5516-4f7b-92ae-5c00ae808f35 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
37232024-08-22T03:19:23.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
37242024-08-22T03:19:23.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
37252024-08-22T03:19:23.239ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
37262024-08-22T03:19:23.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
37272024-08-22T03:19:23.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
37282024-08-22T03:19:23.239ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
37292024-08-22T03:19:23.239ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
37302024-08-22T03:19:23.239ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = bff907f0-2101-418e-8f5d-955661c8bd6f
37312024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
37322024-08-22T03:19:23.240ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-22 03:09:23.239969341 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
37332024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.7\u{b5}s iteration = 9 status = {"error":"blueprint disabled","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f"}
37342024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
37352024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
37362024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
37372024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
37382024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
37392024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
37402024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
37412024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37422024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
37432024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
37442024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
37452024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37462024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
37472024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37482024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
37492024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
37502024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
37512024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
37522024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37532024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37542024-08-22T03:19:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37552024-08-22T03:19:23.241ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3ce7517f-82f9-4849-ad08-7cb0bf67f024.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 759702260 } })
37562024-08-22T03:19:23.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
37572024-08-22T03:19:23.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
37582024-08-22T03:19:23.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37592024-08-22T03:19:23.241ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1467044e-2fe8-4015-be86-a3faa36f1469.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64fff417-46fd-44ed-ac7e-a3829d9efa54.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 759907802 } })
37602024-08-22T03:19:23.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
37612024-08-22T03:19:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37622024-08-22T03:19:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
37632024-08-22T03:19:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
37642024-08-22T03:19:23.242ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-22 03:09:23.239969341 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
37652024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.221708ms iteration = 8 status = {"expiration":"2024-08-22T03:09:23.239969341Z","pruned":[]}
37662024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
37672024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
37682024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37692024-08-22T03:19:23.242ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
37702024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
37712024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
37722024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37732024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
37742024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37752024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
37762024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37772024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
37782024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
37792024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
37802024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
37812024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
37822024-08-22T03:19:23.242ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
37832024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
37842024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37852024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
37862024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
37872024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
37882024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37892024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
37902024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
37912024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37922024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37932024-08-22T03:19:23.242ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
37942024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
37952024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37962024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.925167ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37972024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
37982024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.081028ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
37992024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38002024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38012024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38022024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38032024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38042024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38052024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38062024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38072024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
38082024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38092024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38102024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38112024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
38122024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38132024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38142024-08-22T03:19:23.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38152024-08-22T03:19:23.244ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
38162024-08-22T03:19:23.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.277694ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
38172024-08-22T03:19:23.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38182024-08-22T03:19:23.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38192024-08-22T03:19:23.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38202024-08-22T03:19:23.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 763579588 } })
38212024-08-22T03:19:23.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 763698270 } })
38222024-08-22T03:19:23.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38232024-08-22T03:19:23.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
38242024-08-22T03:19:23.245ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 3.177299ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
38252024-08-22T03:19:23.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38262024-08-22T03:19:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38272024-08-22T03:19:23.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
38282024-08-22T03:19:23.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.232183ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
38292024-08-22T03:19:23.247ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
38302024-08-22T03:19:23.247ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38312024-08-22T03:19:23.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38322024-08-22T03:19:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38332024-08-22T03:19:23.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.79623ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38342024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38352024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38362024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
38372024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38382024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38392024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
38402024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38412024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
38422024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38432024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38442024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38452024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38462024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38472024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38482024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38492024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38502024-08-22T03:19:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38512024-08-22T03:19:23.249ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
38522024-08-22T03:19:23.249ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
38532024-08-22T03:19:23.249ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
38542024-08-22T03:19:23.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
38552024-08-22T03:19:23.249ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38562024-08-22T03:19:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
38572024-08-22T03:19:23.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38582024-08-22T03:19:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38592024-08-22T03:19:23.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38602024-08-22T03:19:23.250ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
38612024-08-22T03:19:23.250ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38622024-08-22T03:19:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 7.312481ms iteration = 15 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
38632024-08-22T03:19:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38642024-08-22T03:19:23.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38652024-08-22T03:19:23.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
38662024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
38672024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
38682024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
38692024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38702024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
38712024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
38722024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
38732024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
38742024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
38752024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
38762024-08-22T03:19:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38772024-08-22T03:19:23.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38782024-08-22T03:19:23.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38792024-08-22T03:19:23.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38802024-08-22T03:19:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38812024-08-22T03:19:23.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38822024-08-22T03:19:23.252ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
38832024-08-22T03:19:23.252ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
38842024-08-22T03:19:23.252ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 9.709432ms iteration = 8 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
38852024-08-22T03:19:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38862024-08-22T03:19:23.253ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38872024-08-22T03:19:23.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882024-08-22T03:19:23.253ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 772201127 } })
38892024-08-22T03:19:23.253ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38902024-08-22T03:19:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38912024-08-22T03:19:23.254ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
38922024-08-22T03:19:23.254ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
38932024-08-22T03:19:23.254ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 11.715248ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
38942024-08-22T03:19:23.254ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38952024-08-22T03:19:23.254ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38962024-08-22T03:19:23.254ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
38972024-08-22T03:19:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38982024-08-22T03:19:23.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 12.69671ms iteration = 15 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
38992024-08-22T03:19:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39002024-08-22T03:19:23.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39012024-08-22T03:19:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39022024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 13.332698ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39032024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
39042024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39052024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39062024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39072024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
39082024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39092024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39102024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39112024-08-22T03:19:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39122024-08-22T03:19:23.257ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
39132024-08-22T03:19:23.257ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
39142024-08-22T03:19:23.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39152024-08-22T03:19:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
39162024-08-22T03:19:23.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39172024-08-22T03:19:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39182024-08-22T03:19:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39192024-08-22T03:19:23.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39202024-08-22T03:19:23.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39212024-08-22T03:19:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39222024-08-22T03:19:23.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39232024-08-22T03:19:23.259ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39242024-08-22T03:19:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39252024-08-22T03:19:23.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39262024-08-22T03:19:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39272024-08-22T03:19:23.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39282024-08-22T03:19:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39292024-08-22T03:19:23.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
39302024-08-22T03:19:23.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
39312024-08-22T03:19:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
39322024-08-22T03:19:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
39332024-08-22T03:19:23.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
39342024-08-22T03:19:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
39352024-08-22T03:19:23.262ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
39362024-08-22T03:19:23.262ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 0 version = 2
39372024-08-22T03:19:23.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39382024-08-22T03:19:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39392024-08-22T03:19:23.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39402024-08-22T03:19:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39412024-08-22T03:19:23.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39422024-08-22T03:19:23.263ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
39432024-08-22T03:19:23.263ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
39442024-08-22T03:19:23.263ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-22 03:13:02.692706 UTC dns_group = internal generation = 1
39452024-08-22T03:19:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 23.91761ms iteration = 9 status = {"generation":1}
39462024-08-22T03:19:23.264ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 22.913198ms iteration = 18 status = {"physical_disks_added":0}
39472024-08-22T03:19:23.264ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
39482024-08-22T03:19:23.264ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.539829ms iteration = 43 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
39492024-08-22T03:19:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
39502024-08-22T03:19:23.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
39512024-08-22T03:19:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
39522024-08-22T03:19:23.267ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 1 version = 2
39532024-08-22T03:19:23.267ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
39542024-08-22T03:19:23.267ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-22 03:13:03.125979 UTC dns_group = external generation = 2
39552024-08-22T03:19:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 27.730359ms iteration = 9 status = {"generation":2}
39562024-08-22T03:19:23.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39572024-08-22T03:19:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39582024-08-22T03:19:23.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39592024-08-22T03:19:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39602024-08-22T03:19:23.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39612024-08-22T03:19:23.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39622024-08-22T03:19:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39632024-08-22T03:19:23.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39642024-08-22T03:19:23.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39652024-08-22T03:19:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39662024-08-22T03:19:23.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39672024-08-22T03:19:23.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39682024-08-22T03:19:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
39692024-08-22T03:19:23.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39702024-08-22T03:19:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39712024-08-22T03:19:23.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39722024-08-22T03:19:23.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39732024-08-22T03:19:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39742024-08-22T03:19:23.276ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 34.025558ms iteration = 15 status = 0
39752024-08-22T03:19:23.306ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-22T03:12:22.052278Z, time_modified: 2024-08-22T03:12:22.052278Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
39762024-08-22T03:19:23.306ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 66.623048ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]}},"default_endpoint":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
39772024-08-22T03:19:23.363ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df9fb791-5fa4-4529-973c-5239ca088ded roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
39782024-08-22T03:19:23.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df9fb791-5fa4-4529-973c-5239ca088ded resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
39792024-08-22T03:19:23.365ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df9fb791-5fa4-4529-973c-5239ca088ded response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
39802024-08-22T03:19:23.453ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
39812024-08-22T03:19:23.459ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
39822024-08-22T03:19:23.459ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39832024-08-22T03:19:23.459ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "68eefc35-b747-49ec-87dd-33f0a04f82bf", "content-length": "26", "date": "Thu, 22 Aug 2024 03:19:22 GMT"} })
39842024-08-22T03:19:23.459ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39852024-08-22T03:19:23.461ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39862024-08-22T03:19:23.489ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39872024-08-22T03:19:23.489ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7021d8aa-639b-47ad-b708-8e3145c01795", "content-length": "583", "date": "Thu, 22 Aug 2024 03:19:22 GMT"} })
39882024-08-22T03:19:23.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39892024-08-22T03:19:23.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39902024-08-22T03:19:23.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39912024-08-22T03:19:23.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39922024-08-22T03:19:23.494ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39932024-08-22T03:19:23.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39942024-08-22T03:19:23.496ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39952024-08-22T03:19:23.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39962024-08-22T03:19:23.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39972024-08-22T03:19:23.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39982024-08-22T03:19:23.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39992024-08-22T03:19:23.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40002024-08-22T03:19:23.502ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40012024-08-22T03:19:23.502ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d3cf2dcb-8581-4f2e-bf5b-b883d18e6005", "date": "Thu, 22 Aug 2024 03:19:22 GMT"} })
40022024-08-22T03:19:23.504ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.863522ms iteration = 16 status = {}
40032024-08-22T03:19:23.510ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509/state
40042024-08-22T03:19:23.510ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = instance_watcher result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509/state", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "914f1019-741a-4b81-9d11-87079d45eac8", "content-length": "183", "date": "Thu, 22 Aug 2024 03:19:22 GMT"} })
40052024-08-22T03:19:23.510ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 state = Running
40062024-08-22T03:19:23.510ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:1846 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2024-08-22T03:19:16.400755755Z }
40072024-08-22T03:19:23.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 roles = RoleSet { roles: {} }
40082024-08-22T03:19:23.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 resource = Database result = Ok(())
40092024-08-22T03:19:23.511ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40102024-08-22T03:19:23.511ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1ff8a3f9-3669-4e7a-8dac-4d8e0c85b680", "content-length": "810", "date": "Thu, 22 Aug 2024 03:19:22 GMT"} })
40112024-08-22T03:19:23.511ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 243, 176, 47])), vni: Vni(4555052) }} sled = buskin
40122024-08-22T03:19:23.511ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
40132024-08-22T03:19:23.511ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
40142024-08-22T03:19:23.513ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 270.293238ms iteration = 15 status = {}
40152024-08-22T03:19:23.515ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
40162024-08-22T03:19:23.515ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 272.672668ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"running":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
40172024-08-22T03:19:23.531ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
40182024-08-22T03:19:23.531ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40192024-08-22T03:19:23.531ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2f34130c-9938-425a-9086-a1fc95f703d2", "content-length": "26", "date": "Thu, 22 Aug 2024 03:19:22 GMT"} })
40202024-08-22T03:19:23.531ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40212024-08-22T03:19:23.533ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
40222024-08-22T03:19:23.573ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
40232024-08-22T03:19:23.620ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
40242024-08-22T03:19:23.621ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
40252024-08-22T03:19:23.621ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40262024-08-22T03:19:23.621ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5d4dc234-c57f-45d9-ad2e-15d66fd7c160", "content-length": "26", "date": "Thu, 22 Aug 2024 03:19:22 GMT"} })
40272024-08-22T03:19:23.621ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40282024-08-22T03:19:23.623ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40292024-08-22T03:19:23.654ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40302024-08-22T03:19:23.655ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b129d296-cf55-40fa-88bc-c6fd938897bf", "content-length": "2", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} })
40312024-08-22T03:19:23.656ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40322024-08-22T03:19:23.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40332024-08-22T03:19:23.658ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 418.521822ms iteration = 15 status = null
40342024-08-22T03:19:23.716ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
40352024-08-22T03:19:23.716ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e0d5ff68-0cc6-4410-84d4-d85a1fdea484", "date": "Thu, 22 Aug 2024 03:19:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40362024-08-22T03:19:23.716ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40372024-08-22T03:19:23.718ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8e331af0-108c-4dde-895a-59d1a3ca846a", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40382024-08-22T03:19:23.718ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40392024-08-22T03:19:23.720ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
40402024-08-22T03:19:23.720ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 480.224347ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
40412024-08-22T03:19:23.731ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
40422024-08-22T03:19:23.731ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7c7f586c-2783-4dde-b244-f506bf136d47", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
40432024-08-22T03:19:23.731ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
40442024-08-22T03:19:23.733ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6cdd0086-354d-420a-87ca-86ba7fc4e188", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
40452024-08-22T03:19:23.733ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
40462024-08-22T03:19:23.734ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 494.76449ms iteration = 15 status = {}
40472024-08-22T03:19:23.736ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b00ad253-7c87-48a8-8a6d-6fd5cdd55e0d", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
40482024-08-22T03:19:23.736ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
40492024-08-22T03:19:23.738ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
40502024-08-22T03:19:23.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 498.302405ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
40512024-08-22T03:19:23.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40522024-08-22T03:19:23.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40532024-08-22T03:19:23.780ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
40542024-08-22T03:19:23.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40552024-08-22T03:19:23.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40562024-08-22T03:19:23.786ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40572024-08-22T03:19:23.786ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7bddd8e6-4461-4134-ac6c-caef741b0e64", "content-length": "121", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} })
40582024-08-22T03:19:23.786ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
40592024-08-22T03:19:23.786ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
40602024-08-22T03:19:23.787ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40612024-08-22T03:19:23.787ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40622024-08-22T03:19:23.787ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
40632024-08-22T03:19:23.787ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
40642024-08-22T03:19:23.787ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
40652024-08-22T03:19:23.787ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40662024-08-22T03:19:23.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40672024-08-22T03:19:23.788ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40682024-08-22T03:19:23.788ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f06665fb-7859-41bf-9413-1532cf74236f", "content-length": "2", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} })
40692024-08-22T03:19:23.788ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40702024-08-22T03:19:23.789ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10152f4c-914f-45a6-8392-42fb6dc30983", "content-length": "51", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} })
40712024-08-22T03:19:23.789ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
40722024-08-22T03:19:23.789ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40732024-08-22T03:19:23.881ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "078b3ad7-633f-4653-96df-bf83141f8d7e", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} })
40742024-08-22T03:19:23.881ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
40752024-08-22T03:19:23.881ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40762024-08-22T03:19:23.881ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7d2b5653-44ac-4705-a2d5-b3684cac7c9e", "content-length": "667", "date": "Thu, 22 Aug 2024 03:19:23 GMT"} })
40772024-08-22T03:19:23.881ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40782024-08-22T03:19:23.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40792024-08-22T03:19:23.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40802024-08-22T03:19:23.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40812024-08-22T03:19:23.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40822024-08-22T03:19:23.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40832024-08-22T03:19:23.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40842024-08-22T03:19:23.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40852024-08-22T03:19:23.897ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 655.100005ms iteration = 15 status = {}
40862024-08-22T03:19:24.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b4fa71ee-bae1-4f15-b070-2a5874a59490 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
40872024-08-22T03:19:24.385ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b4fa71ee-bae1-4f15-b070-2a5874a59490 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
40882024-08-22T03:19:24.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b4fa71ee-bae1-4f15-b070-2a5874a59490 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
40892024-08-22T03:19:24.526ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = a8d886e6-5a3f-47a3-83eb-3bcb20f59ef7 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
40902024-08-22T03:19:25.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1795ff3b-eca0-49c5-bdaf-109be963c3ef roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
40912024-08-22T03:19:25.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1795ff3b-eca0-49c5-bdaf-109be963c3ef resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
40922024-08-22T03:19:25.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1795ff3b-eca0-49c5-bdaf-109be963c3ef response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
40932024-08-22T03:19:26.306ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 remote_addr = [fd00:1122:3344:101::1]:36401 req_id = eb2c0610-cb3c-4234-b937-c905421ad7d4 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2024-08-22T03:19:26.305882188Z }
40942024-08-22T03:19:26.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = eb2c0610-cb3c-4234-b937-c905421ad7d4 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
40952024-08-22T03:19:26.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = eb2c0610-cb3c-4234-b937-c905421ad7d4 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
40962024-08-22T03:19:26.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 22183 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = eb2c0610-cb3c-4234-b937-c905421ad7d4 response_code = 204 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
40972024-08-22T03:19:26.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82dec53d-b1d2-4c46-974e-fc531ac143ad roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
40982024-08-22T03:19:26.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82dec53d-b1d2-4c46-974e-fc531ac143ad resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
40992024-08-22T03:19:26.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 82dec53d-b1d2-4c46-974e-fc531ac143ad response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
41002024-08-22T03:19:26.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = d619f5e6-8d06-425a-a9ee-23af68515cdb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
41012024-08-22T03:19:26.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = d619f5e6-8d06-425a-a9ee-23af68515cdb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
41022024-08-22T03:19:26.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = d619f5e6-8d06-425a-a9ee-23af68515cdb response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
41032024-08-22T03:19:26.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 59f88025-f645-4bbf-9dd2-8c8b7eafdd28 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
41042024-08-22T03:19:26.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 59f88025-f645-4bbf-9dd2-8c8b7eafdd28 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
41052024-08-22T03:19:26.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 59f88025-f645-4bbf-9dd2-8c8b7eafdd28 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
41062024-08-22T03:19:27.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9388a10-84db-40b6-b77f-d5bf77aac5f4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
41072024-08-22T03:19:27.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9388a10-84db-40b6-b77f-d5bf77aac5f4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
41082024-08-22T03:19:27.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9388a10-84db-40b6-b77f-d5bf77aac5f4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
41092024-08-22T03:19:27.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 80d528b5-3136-46e7-a6c7-48de31a73b57 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
41102024-08-22T03:19:27.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 80d528b5-3136-46e7-a6c7-48de31a73b57 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
41112024-08-22T03:19:27.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 80d528b5-3136-46e7-a6c7-48de31a73b57 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
41122024-08-22T03:19:28.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d121c1df-a85a-445d-8ebf-e43f77b78ed7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
41132024-08-22T03:19:28.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d121c1df-a85a-445d-8ebf-e43f77b78ed7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
41142024-08-22T03:19:28.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d121c1df-a85a-445d-8ebf-e43f77b78ed7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
41152024-08-22T03:19:28.712ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-22T03:19:28.712256843Z }
41162024-08-22T03:19:28.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41172024-08-22T03:19:28.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41182024-08-22T03:19:28.730ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509 vmm_needs_update = true
41192024-08-22T03:19:28.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41202024-08-22T03:19:28.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41212024-08-22T03:19:28.732ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41222024-08-22T03:19:28.733ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41232024-08-22T03:19:28.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41242024-08-22T03:19:28.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41252024-08-22T03:19:28.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41262024-08-22T03:19:28.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41272024-08-22T03:19:28.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41282024-08-22T03:19:28.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41292024-08-22T03:19:28.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41302024-08-22T03:19:28.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41312024-08-22T03:19:28.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41322024-08-22T03:19:28.741ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bb5b3233-d1df-448e-96fb-5a4c37e5412b, lookup_type: ById(bb5b3233-d1df-448e-96fb-5a4c37e5412b) }, key: 1379954a-83b9-41e2-8ef9-fcd2c647d838, lookup_type: ById(1379954a-83b9-41e2-8ef9-fcd2c647d838) }, key: 368a50e4-a99c-4eb0-9769-fd4c47a9f509, lookup_type: ById(368a50e4-a99c-4eb0-9769-fd4c47a9f509) } result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41332024-08-22T03:19:28.741ZINFOnexus (dropshot_internal): starting update saga for 368a50e4-a99c-4eb0-9769-fd4c47a9f509 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1348 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-22T03:19:28.712256843Z }
41342024-08-22T03:19:28.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 28693 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bae434da-b3a2-4d68-9aa9-da45d14bdf29 response_code = 204 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41352024-08-22T03:19:28.741ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1846 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0793253e-2b49-4991-b4c0-8e1071015c01 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2024-08-22T03:19:28.712256843Z }
41362024-08-22T03:19:28.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0793253e-2b49-4991-b4c0-8e1071015c01 roles = RoleSet { roles: {} } uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41372024-08-22T03:19:28.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0793253e-2b49-4991-b4c0-8e1071015c01 resource = Database result = Ok(()) uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41382024-08-22T03:19:28.743ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update
41392024-08-22T03:19:28.743ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"368a50e4-a99c-4eb0-9769-fd4c47a9f509","lookup_type":{"ById":"368a50e4-a99c-4eb0-9769-fd4c47a9f509"},"parent":{"key":"1379954a-83b9-41e2-8ef9-fcd2c647d838","lookup_type":{"ById":"1379954a-83b9-41e2-8ef9-fcd2c647d838"},"parent":{"key":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","lookup_type":{"ById":"bb5b3233-d1df-448e-96fb-5a4c37e5412b"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41402024-08-22T03:19:28.743ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update
41412024-08-22T03:19:28.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3336 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0793253e-2b49-4991-b4c0-8e1071015c01 response_code = 204 uri = /instances/368a50e4-a99c-4eb0-9769-fd4c47a9f509
41422024-08-22T03:19:28.750ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update
41432024-08-22T03:19:28.750ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41442024-08-22T03:19:28.750ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41452024-08-22T03:19:28.750ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
41462024-08-22T03:19:28.756ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41472024-08-22T03:19:28.756ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
41482024-08-22T03:19:28.759ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41492024-08-22T03:19:28.759ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
41502024-08-22T03:19:28.765ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41512024-08-22T03:19:28.765ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("21b5cc8c-0ddd-44b3-b294-82e354a42dfa")) node_id = 0 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
41522024-08-22T03:19:28.769ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41532024-08-22T03:19:28.769ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
41542024-08-22T03:19:28.782ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update
41552024-08-22T03:19:28.782ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41562024-08-22T03:19:28.782ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41572024-08-22T03:19:28.784ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41582024-08-22T03:19:28.784ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41592024-08-22T03:19:28.785ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41602024-08-22T03:19:28.785ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41612024-08-22T03:19:28.786ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41622024-08-22T03:19:28.786ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41632024-08-22T03:19:28.787ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41642024-08-22T03:19:28.787ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41652024-08-22T03:19:28.788ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41662024-08-22T03:19:28.788ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41672024-08-22T03:19:28.789ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41682024-08-22T03:19:28.792ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bb5b3233-d1df-448e-96fb-5a4c37e5412b, lookup_type: ById(bb5b3233-d1df-448e-96fb-5a4c37e5412b) }, key: 1379954a-83b9-41e2-8ef9-fcd2c647d838, lookup_type: ById(1379954a-83b9-41e2-8ef9-fcd2c647d838) }, key: 368a50e4-a99c-4eb0-9769-fd4c47a9f509, lookup_type: ById(368a50e4-a99c-4eb0-9769-fd4c47a9f509) } result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41692024-08-22T03:19:28.792ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance updater_id = 21b5cc8c-0ddd-44b3-b294-82e354a42dfa
41702024-08-22T03:19:28.792ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41712024-08-22T03:19:28.792ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41722024-08-22T03:19:28.803ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance updater_id = 21b5cc8c-0ddd-44b3-b294-82e354a42dfa
41732024-08-22T03:19:28.803ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41742024-08-22T03:19:28.803ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance
41752024-08-22T03:19:28.806ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 locked_gen = Generation(Generation(2)) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = LockInstance updater_id = 21b5cc8c-0ddd-44b3-b294-82e354a42dfa
41762024-08-22T03:19:28.806ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41772024-08-22T03:19:28.806ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("21b5cc8c-0ddd-44b3-b294-82e354a42dfa")}) node_id = 1 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
41782024-08-22T03:19:28.812ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41792024-08-22T03:19:28.812ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
41802024-08-22T03:19:28.817ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41812024-08-22T03:19:28.817ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41822024-08-22T03:19:28.818ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41832024-08-22T03:19:28.818ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41842024-08-22T03:19:28.819ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41852024-08-22T03:19:28.819ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41862024-08-22T03:19:28.820ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41872024-08-22T03:19:28.823ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bb5b3233-d1df-448e-96fb-5a4c37e5412b, lookup_type: ById(bb5b3233-d1df-448e-96fb-5a4c37e5412b) }, key: 1379954a-83b9-41e2-8ef9-fcd2c647d838, lookup_type: ById(1379954a-83b9-41e2-8ef9-fcd2c647d838) }, key: 368a50e4-a99c-4eb0-9769-fd4c47a9f509, lookup_type: ById(368a50e4-a99c-4eb0-9769-fd4c47a9f509) } result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41882024-08-22T03:19:28.823ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41892024-08-22T03:19:28.823ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
41902024-08-22T03:19:28.828ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: 2c219624-c497-4701-8ca2-8b7159f11584, time_created: 2024-08-22T03:19:08.372198Z, time_deleted: None, instance_id: 368a50e4-a99c-4eb0-9769-fd4c47a9f509, sled_id: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-08-22T03:19:28.712256Z, gen: Generation(Generation(7)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-08-22T03:19:08.420277Z, gen: Generation(Generation(3)), propolis_id: Some(2c219624-c497-4701-8ca2-8b7159f11584), dst_propolis_id: None, migration_id: None, nexus_state: Vmm } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(2c219624-c497-4701-8ca2-8b7159f11584 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-08-22T03:19:28.828003689Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm }
41912024-08-22T03:19:28.828ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:212 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
41922024-08-22T03:19:28.828ZINFOnexus (SEC): saga create dag = {"end_node":13,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[12,0,null],[11,13,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"368a50e4-a99c-4eb0-9769-fd4c47a9f509","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"2c219624-c497-4701-8ca2-8b7159f11584"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Start":{"params":{"authz_instance":{"key":"368a50e4-a99c-4eb0-9769-fd4c47a9f509","lookup_type":{"ById":"368a50e4-a99c-4eb0-9769-fd4c47a9f509"},"parent":{"key":"1379954a-83b9-41e2-8ef9-fcd2c647d838","lookup_type":{"ById":"1379954a-83b9-41e2-8ef9-fcd2c647d838"},"parent":{"key":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","lookup_type":{"ById":"bb5b3233-d1df-448e-96fb-5a4c37e5412b"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"21b5cc8c-0ddd-44b3-b294-82e354a42dfa"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"1379954a-83b9-41e2-8ef9-fcd2c647d838","ram_diff":1073741824},"destroy_active_vmm":"2c219624-c497-4701-8ca2-8b7159f11584","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_updated":"2024-08-22T03:19:28.828003689Z"}}}}},"End"]},"saga_name":"instance-update","start_node":12} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41932024-08-22T03:19:28.828ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
41942024-08-22T03:19:28.832ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:310 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
41952024-08-22T03:19:28.832ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41962024-08-22T03:19:28.832ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41972024-08-22T03:19:28.832ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
41982024-08-22T03:19:28.838ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
41992024-08-22T03:19:28.838ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42002024-08-22T03:19:28.844ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42012024-08-22T03:19:28.844ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42022024-08-22T03:19:28.848ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42032024-08-22T03:19:28.848ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("1f66179f-926a-4015-b567-0f43f33a4354")) node_id = 0 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42042024-08-22T03:19:28.851ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42052024-08-22T03:19:28.851ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42062024-08-22T03:19:28.858ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 parent_lock = UpdaterLock { updater_id: 21b5cc8c-0ddd-44b3-b294-82e354a42dfa, locked_gen: Generation(Generation(2)) } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42072024-08-22T03:19:28.858ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = BecomeUpdater
42082024-08-22T03:19:28.858ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = BecomeUpdater
42092024-08-22T03:19:28.868ZDEBGnexus (SagaExecutor): inherited lock from 21b5cc8c-0ddd-44b3-b294-82e354a42dfa to 1f66179f-926a-4015-b567-0f43f33a4354 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 21b5cc8c-0ddd-44b3-b294-82e354a42dfa saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = BecomeUpdater updater_id = 1f66179f-926a-4015-b567-0f43f33a4354
42102024-08-22T03:19:28.868ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:933 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42112024-08-22T03:19:28.868ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42122024-08-22T03:19:28.868ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("1f66179f-926a-4015-b567-0f43f33a4354")}) node_id = 1 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42132024-08-22T03:19:28.874ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42142024-08-22T03:19:28.874ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42152024-08-22T03:19:28.878ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42162024-08-22T03:19:28.878ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42172024-08-22T03:19:28.884ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42182024-08-22T03:19:28.884ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42192024-08-22T03:19:28.888ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:986 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42202024-08-22T03:19:28.892ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509
42212024-08-22T03:19:28.895ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UpdateNetworkConfig
42222024-08-22T03:19:28.895ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UpdateNetworkConfig
42232024-08-22T03:19:28.900ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UpdateNetworkConfig
42242024-08-22T03:19:28.900ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UpdateNetworkConfig
42252024-08-22T03:19:28.901ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
42262024-08-22T03:19:28.901ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UpdateNetworkConfig
42272024-08-22T03:19:28.902ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UpdateNetworkConfig
42282024-08-22T03:19:28.903ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
42292024-08-22T03:19:28.903ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
42302024-08-22T03:19:28.903ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
42312024-08-22T03:19:28.904ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
42322024-08-22T03:19:28.905ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
42332024-08-22T03:19:28.905ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
42342024-08-22T03:19:28.905ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
42352024-08-22T03:19:28.909ZDEBGnexus: notifying dendrite of updates instance_id = Some(368a50e4-a99c-4eb0-9769-fd4c47a9f509 (instance)) switch = switch0
42362024-08-22T03:19:28.909ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1473, tv_nsec: 427952886 } })
42372024-08-22T03:19:28.910ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1050
42382024-08-22T03:19:28.940ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
42392024-08-22T03:19:28.940ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
42402024-08-22T03:19:28.941ZDEBGnexus (MgsClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ed449ae8-33a5-4ca8-b874-d487b7253628", "content-length": "26", "date": "Thu, 22 Aug 2024 03:19:28 GMT"} })
42412024-08-22T03:19:28.941ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
42422024-08-22T03:19:28.941ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
42432024-08-22T03:19:28.971ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
42442024-08-22T03:19:28.971ZDEBGnexus (DpdClient): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/trigger", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "cdefcc55-4f52-45b7-9326-1bd3f4779d9c", "content-length": "4", "date": "Thu, 22 Aug 2024 03:19:28 GMT"} })
42452024-08-22T03:19:28.972ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42462024-08-22T03:19:28.972ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42472024-08-22T03:19:28.978ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42482024-08-22T03:19:28.978ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42492024-08-22T03:19:28.982ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
42502024-08-22T03:19:28.982ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
42512024-08-22T03:19:29.000ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1061 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-08-22T03:19:28.984713Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 1379954a-83b9-41e2-8ef9-fcd2c647d838, time_modified: Some(2024-08-22T03:19:28.984713Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, time_modified: Some(2024-08-22T03:19:28.984713Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42522024-08-22T03:19:29.000ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42532024-08-22T03:19:29.000ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42542024-08-22T03:19:29.006ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42552024-08-22T03:19:29.006ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42562024-08-22T03:19:29.012ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1096 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42572024-08-22T03:19:29.015ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UnassignOximeterProducer
42582024-08-22T03:19:29.015ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UnassignOximeterProducer
42592024-08-22T03:19:29.020ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = d035b4c1-6b21-454e-a5db-9173950866fd producer_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42602024-08-22T03:19:29.020ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UnassignOximeterProducer
42612024-08-22T03:19:29.020ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = UnassignOximeterProducer
42622024-08-22T03:19:29.052ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42632024-08-22T03:19:29.052ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/368a50e4-a99c-4eb0-9769-fd4c47a9f509
42642024-08-22T03:19:29.052ZDEBGnexus (SagaExecutor): client response oximeter-collector = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers/368a50e4-a99c-4eb0-9769-fd4c47a9f509", query: None, fragment: None }, status: 204, headers: {"x-request-id": "518c3da6-d361-4dd4-9420-9d3131c0a4c2", "date": "Thu, 22 Aug 2024 03:19:29 GMT"} }) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42652024-08-22T03:19:29.052ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = d035b4c1-6b21-454e-a5db-9173950866fd producer_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42662024-08-22T03:19:29.055ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42672024-08-22T03:19:29.055ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42682024-08-22T03:19:29.062ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42692024-08-22T03:19:29.062ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
42702024-08-22T03:19:29.069ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 lock = UpdaterLock { updater_id: 1f66179f-926a-4015-b567-0f43f33a4354, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-08-22T03:19:28.828003689Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42712024-08-22T03:19:29.072ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42722024-08-22T03:19:29.072ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42732024-08-22T03:19:29.111ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1145 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 new_runtime = InstanceRuntimeState { time_updated: 2024-08-22T03:19:28.828003689Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
42742024-08-22T03:19:29.111ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42752024-08-22T03:19:29.111ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Signaled
42762024-08-22T03:19:29.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42772024-08-22T03:19:29.111ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42782024-08-22T03:19:29.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42792024-08-22T03:19:29.111ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Signaled
42802024-08-22T03:19:29.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42812024-08-22T03:19:29.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42822024-08-22T03:19:29.112ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42832024-08-22T03:19:29.112ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42842024-08-22T03:19:29.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42852024-08-22T03:19:29.113ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42862024-08-22T03:19:29.113ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42872024-08-22T03:19:29.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42882024-08-22T03:19:29.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42892024-08-22T03:19:29.114ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42902024-08-22T03:19:29.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42912024-08-22T03:19:29.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42922024-08-22T03:19:29.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42932024-08-22T03:19:29.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42942024-08-22T03:19:29.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42952024-08-22T03:19:29.117ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: bb5b3233-d1df-448e-96fb-5a4c37e5412b, lookup_type: ById(bb5b3233-d1df-448e-96fb-5a4c37e5412b) }, key: 1379954a-83b9-41e2-8ef9-fcd2c647d838, lookup_type: ById(1379954a-83b9-41e2-8ef9-fcd2c647d838) }, key: 368a50e4-a99c-4eb0-9769-fd4c47a9f509, lookup_type: ById(368a50e4-a99c-4eb0-9769-fd4c47a9f509) } result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42962024-08-22T03:19:29.117ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42972024-08-22T03:19:29.117ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = CommitInstanceUpdates
42982024-08-22T03:19:29.120ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
42992024-08-22T03:19:29.120ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43002024-08-22T03:19:29.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43012024-08-22T03:19:29.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43022024-08-22T03:19:29.124ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43032024-08-22T03:19:29.124ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43042024-08-22T03:19:29.128ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43052024-08-22T03:19:29.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43062024-08-22T03:19:29.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43072024-08-22T03:19:29.130ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43082024-08-22T03:19:29.130ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("368a50e4-a99c-4eb0-9769-fd4c47a9f509"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2c219624-c497-4701-8ca2-8b7159f11584")}) node_id = 7 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43092024-08-22T03:19:29.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43102024-08-22T03:19:29.131ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43112024-08-22T03:19:29.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43122024-08-22T03:19:29.133ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43132024-08-22T03:19:29.134ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43142024-08-22T03:19:29.134ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43152024-08-22T03:19:29.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43162024-08-22T03:19:29.134ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43172024-08-22T03:19:29.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43182024-08-22T03:19:29.139ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43192024-08-22T03:19:29.139ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43202024-08-22T03:19:29.144ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43212024-08-22T03:19:29.144ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43222024-08-22T03:19:29.155ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
43232024-08-22T03:19:29.155ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = ReleaseSledResources
43242024-08-22T03:19:29.155ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = ReleaseSledResources
43252024-08-22T03:19:29.162ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43262024-08-22T03:19:29.162ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43272024-08-22T03:19:29.165ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43282024-08-22T03:19:29.166ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6ffabdbc-b21d-4d6f-91d1-c3ae87dbcbde", "content-length": "372", "date": "Thu, 22 Aug 2024 03:19:29 GMT"} })
43292024-08-22T03:19:29.166ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43302024-08-22T03:19:29.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43312024-08-22T03:19:29.167ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43322024-08-22T03:19:29.167ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43332024-08-22T03:19:29.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43342024-08-22T03:19:29.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43352024-08-22T03:19:29.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43362024-08-22T03:19:29.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43372024-08-22T03:19:29.170ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 propolis_id = 2c219624-c497-4701-8ca2-8b7159f11584 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update
43382024-08-22T03:19:29.170ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = MarkVmmDeleted
43392024-08-22T03:19:29.171ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_node = MarkVmmDeleted
43402024-08-22T03:19:29.171ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43412024-08-22T03:19:29.172ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "05a4ee40-c45f-448e-9ac2-dc4a94c350d7", "date": "Thu, 22 Aug 2024 03:19:29 GMT"} })
43422024-08-22T03:19:29.173ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 61.773407ms iteration = 17 status = {}
43432024-08-22T03:19:29.181ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43442024-08-22T03:19:29.181ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43452024-08-22T03:19:29.183ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
43462024-08-22T03:19:29.183ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "274e76b7-bd41-4092-ab2f-a64e1c805de2", "content-length": "691", "date": "Thu, 22 Aug 2024 03:19:29 GMT"} })
43472024-08-22T03:19:29.183ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
43482024-08-22T03:19:29.183ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
43492024-08-22T03:19:29.183ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
43502024-08-22T03:19:29.185ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 74.395885ms iteration = 16 status = {}
43512024-08-22T03:19:29.186ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43522024-08-22T03:19:29.186ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43532024-08-22T03:19:29.192ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43542024-08-22T03:19:29.192ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43552024-08-22T03:19:29.196ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43562024-08-22T03:19:29.196ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43572024-08-22T03:19:29.202ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43582024-08-22T03:19:29.202ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43592024-08-22T03:19:29.209ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43602024-08-22T03:19:29.209ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
43612024-08-22T03:19:29.252ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43622024-08-22T03:19:29.252ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 saga_name = instance-update saga_result = SagaResult { saga_id: 83d39d43-9617-4649-9979-c84aeb9dcee3, saga_log: SagaLog { saga_id: 83d39d43-9617-4649-9979-c84aeb9dcee3, unwinding: false, events: [N012 started, N012 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N013 started, N013 succeeded], node_status: {0: Succeeded(String("1f66179f-926a-4015-b567-0f43f33a4354")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("1f66179f-926a-4015-b567-0f43f33a4354")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("368a50e4-a99c-4eb0-9769-fd4c47a9f509"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2c219624-c497-4701-8ca2-8b7159f11584")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("368a50e4-a99c-4eb0-9769-fd4c47a9f509"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("2c219624-c497-4701-8ca2-8b7159f11584")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("1f66179f-926a-4015-b567-0f43f33a4354"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("1f66179f-926a-4015-b567-0f43f33a4354")}} }) }
43632024-08-22T03:19:29.252ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3 instance_id = 368a50e4-a99c-4eb0-9769-fd4c47a9f509 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update
43642024-08-22T03:19:29.252ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43652024-08-22T03:19:29.252ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
43662024-08-22T03:19:29.259ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43672024-08-22T03:19:29.259ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
43682024-08-22T03:19:29.263ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43692024-08-22T03:19:29.263ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
43702024-08-22T03:19:29.269ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43712024-08-22T03:19:29.269ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
43722024-08-22T03:19:29.278ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update sec_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
43732024-08-22T03:19:29.278ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:361 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273 saga_name = start-instance-update saga_result = SagaResult { saga_id: b8a19120-3bee-46ed-8e0a-5c18aa3f9273, saga_log: SagaLog { saga_id: b8a19120-3bee-46ed-8e0a-5c18aa3f9273, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("21b5cc8c-0ddd-44b3-b294-82e354a42dfa")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("21b5cc8c-0ddd-44b3-b294-82e354a42dfa")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("21b5cc8c-0ddd-44b3-b294-82e354a42dfa"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("21b5cc8c-0ddd-44b3-b294-82e354a42dfa")}} }) }
43742024-08-22T03:19:29.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 834e8d88-30c9-4b96-9542-0cdc242e06dc roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43752024-08-22T03:19:29.494ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 834e8d88-30c9-4b96-9542-0cdc242e06dc resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43762024-08-22T03:19:29.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 834e8d88-30c9-4b96-9542-0cdc242e06dc response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43772024-08-22T03:19:29.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 2890d3d2-c82e-474f-be9e-b69869008b55 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
43782024-08-22T03:19:29.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 2890d3d2-c82e-474f-be9e-b69869008b55 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
43792024-08-22T03:19:29.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2772 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 2890d3d2-c82e-474f-be9e-b69869008b55 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
43802024-08-22T03:19:30.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = eade8ea9-84d2-4f73-a1f3-0be34fdc0be2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43812024-08-22T03:19:30.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = eade8ea9-84d2-4f73-a1f3-0be34fdc0be2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43822024-08-22T03:19:30.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = eade8ea9-84d2-4f73-a1f3-0be34fdc0be2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43832024-08-22T03:19:31.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 618fcc07-8ed9-464c-8c11-854f38a60686 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43842024-08-22T03:19:31.537ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 618fcc07-8ed9-464c-8c11-854f38a60686 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43852024-08-22T03:19:31.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 618fcc07-8ed9-464c-8c11-854f38a60686 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43862024-08-22T03:19:32.558ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db13b44c-9f58-4de2-a1c5-cf3ffe9bc3f4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43872024-08-22T03:19:32.558ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db13b44c-9f58-4de2-a1c5-cf3ffe9bc3f4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43882024-08-22T03:19:32.560ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = db13b44c-9f58-4de2-a1c5-cf3ffe9bc3f4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
43892024-08-22T03:19:33.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
43902024-08-22T03:19:33.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43912024-08-22T03:19:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43922024-08-22T03:19:33.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43932024-08-22T03:19:33.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
43942024-08-22T03:19:33.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43952024-08-22T03:19:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43962024-08-22T03:19:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43972024-08-22T03:19:33.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43982024-08-22T03:19:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43992024-08-22T03:19:33.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44002024-08-22T03:19:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44012024-08-22T03:19:33.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44022024-08-22T03:19:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44032024-08-22T03:19:33.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.101429ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44042024-08-22T03:19:33.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44052024-08-22T03:19:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
44062024-08-22T03:19:33.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44072024-08-22T03:19:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44082024-08-22T03:19:33.255ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
44092024-08-22T03:19:33.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.522966ms iteration = 44 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
44102024-08-22T03:19:33.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2de8999f-e550-4942-9531-9d7e1e14c6d0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44112024-08-22T03:19:33.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2de8999f-e550-4942-9531-9d7e1e14c6d0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44122024-08-22T03:19:33.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2de8999f-e550-4942-9531-9d7e1e14c6d0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44132024-08-22T03:19:34.526ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 6f85c3f8-6486-4968-a4ab-2a70b4f3e374 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
44142024-08-22T03:19:34.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 049a6d92-ed7b-40b2-bb8f-f422fbbc57fa roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44152024-08-22T03:19:34.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 049a6d92-ed7b-40b2-bb8f-f422fbbc57fa resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44162024-08-22T03:19:34.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 049a6d92-ed7b-40b2-bb8f-f422fbbc57fa response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44172024-08-22T03:19:35.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bf815a59-c613-4042-aaea-2c3c6edec75b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44182024-08-22T03:19:35.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bf815a59-c613-4042-aaea-2c3c6edec75b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44192024-08-22T03:19:35.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = bf815a59-c613-4042-aaea-2c3c6edec75b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44202024-08-22T03:19:36.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d77d2374-d798-42c5-ae8d-4993ea1de87d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44212024-08-22T03:19:36.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d77d2374-d798-42c5-ae8d-4993ea1de87d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44222024-08-22T03:19:36.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d77d2374-d798-42c5-ae8d-4993ea1de87d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44232024-08-22T03:19:37.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b846ec5c-eaa5-418a-9076-a490964986a8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44242024-08-22T03:19:37.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b846ec5c-eaa5-418a-9076-a490964986a8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44252024-08-22T03:19:37.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b846ec5c-eaa5-418a-9076-a490964986a8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44262024-08-22T03:19:38.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dc8d069c-af2e-4264-a5ef-7f7108e47f07 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44272024-08-22T03:19:38.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dc8d069c-af2e-4264-a5ef-7f7108e47f07 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44282024-08-22T03:19:38.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dc8d069c-af2e-4264-a5ef-7f7108e47f07 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44292024-08-22T03:19:39.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22e83a71-cec0-4b51-a6da-e9889e71b84f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44302024-08-22T03:19:39.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22e83a71-cec0-4b51-a6da-e9889e71b84f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44312024-08-22T03:19:39.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22e83a71-cec0-4b51-a6da-e9889e71b84f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44322024-08-22T03:19:40.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4e1bda2d-8e6b-4800-ad06-b7aa9af1c626 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44332024-08-22T03:19:40.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4e1bda2d-8e6b-4800-ad06-b7aa9af1c626 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44342024-08-22T03:19:40.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4e1bda2d-8e6b-4800-ad06-b7aa9af1c626 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44352024-08-22T03:19:41.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ea2c1f70-f2af-41b2-8a3c-66fef3d90965 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44362024-08-22T03:19:41.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ea2c1f70-f2af-41b2-8a3c-66fef3d90965 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44372024-08-22T03:19:41.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ea2c1f70-f2af-41b2-8a3c-66fef3d90965 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44382024-08-22T03:19:42.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8473d0da-a4db-4dc2-b8a2-37f4121bd64d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44392024-08-22T03:19:42.770ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8473d0da-a4db-4dc2-b8a2-37f4121bd64d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44402024-08-22T03:19:42.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8473d0da-a4db-4dc2-b8a2-37f4121bd64d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44412024-08-22T03:19:43.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
44422024-08-22T03:19:43.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44432024-08-22T03:19:43.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44442024-08-22T03:19:43.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44452024-08-22T03:19:43.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
44462024-08-22T03:19:43.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44472024-08-22T03:19:43.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44482024-08-22T03:19:43.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44492024-08-22T03:19:43.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44502024-08-22T03:19:43.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44512024-08-22T03:19:43.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44522024-08-22T03:19:43.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44532024-08-22T03:19:43.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44542024-08-22T03:19:43.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44552024-08-22T03:19:43.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.093959ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44562024-08-22T03:19:43.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44572024-08-22T03:19:43.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
44582024-08-22T03:19:43.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44592024-08-22T03:19:43.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44602024-08-22T03:19:43.255ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
44612024-08-22T03:19:43.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.680207ms iteration = 45 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
44622024-08-22T03:19:43.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ab10375-4357-404e-8621-514ff054276f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44632024-08-22T03:19:43.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ab10375-4357-404e-8621-514ff054276f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44642024-08-22T03:19:43.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ab10375-4357-404e-8621-514ff054276f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44652024-08-22T03:19:44.526ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2024 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 641cea32-9772-4bca-a7fa-d2cc0a738401 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
44662024-08-22T03:19:44.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f4764aae-dedf-4fb0-8684-309fb38a1934 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44672024-08-22T03:19:44.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f4764aae-dedf-4fb0-8684-309fb38a1934 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44682024-08-22T03:19:44.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f4764aae-dedf-4fb0-8684-309fb38a1934 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44692024-08-22T03:19:45.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e2c7fe1-5699-468e-922f-e408c675a230 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44702024-08-22T03:19:45.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e2c7fe1-5699-468e-922f-e408c675a230 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44712024-08-22T03:19:45.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e2c7fe1-5699-468e-922f-e408c675a230 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44722024-08-22T03:19:46.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a06500b2-53c7-4416-b0e4-6cfd863e32a2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44732024-08-22T03:19:46.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a06500b2-53c7-4416-b0e4-6cfd863e32a2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44742024-08-22T03:19:46.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a06500b2-53c7-4416-b0e4-6cfd863e32a2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44752024-08-22T03:19:47.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b4cc7ac-59ab-4743-8b0a-d8fa85849669 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44762024-08-22T03:19:47.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b4cc7ac-59ab-4743-8b0a-d8fa85849669 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44772024-08-22T03:19:47.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b4cc7ac-59ab-4743-8b0a-d8fa85849669 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44782024-08-22T03:19:48.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8c33ef50-c719-4b07-b13d-119b5f9a48e0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44792024-08-22T03:19:48.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8c33ef50-c719-4b07-b13d-119b5f9a48e0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44802024-08-22T03:19:48.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8c33ef50-c719-4b07-b13d-119b5f9a48e0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44812024-08-22T03:19:49.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 88cd3c8e-3e4e-4ba8-bf0f-e02b79a9e211 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44822024-08-22T03:19:49.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 88cd3c8e-3e4e-4ba8-bf0f-e02b79a9e211 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44832024-08-22T03:19:49.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 88cd3c8e-3e4e-4ba8-bf0f-e02b79a9e211 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44842024-08-22T03:19:50.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b82dd89-fa92-4fcd-b170-6b39e7dbb7ff roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44852024-08-22T03:19:50.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b82dd89-fa92-4fcd-b170-6b39e7dbb7ff resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44862024-08-22T03:19:50.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4b82dd89-fa92-4fcd-b170-6b39e7dbb7ff response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44872024-08-22T03:19:51.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4cd97735-b97f-42f4-b7e0-4ef213cabaf5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44882024-08-22T03:19:51.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4cd97735-b97f-42f4-b7e0-4ef213cabaf5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44892024-08-22T03:19:51.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4cd97735-b97f-42f4-b7e0-4ef213cabaf5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44902024-08-22T03:19:53.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c8fb011d-919c-4d68-a3c6-93772de23bfe roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44912024-08-22T03:19:53.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c8fb011d-919c-4d68-a3c6-93772de23bfe resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44922024-08-22T03:19:53.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c8fb011d-919c-4d68-a3c6-93772de23bfe response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
44932024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
44942024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
44952024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44962024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
44972024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
44982024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
44992024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45002024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45012024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45022024-08-22T03:19:53.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45032024-08-22T03:19:53.241ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
45042024-08-22T03:19:53.241ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45052024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45072024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.669364ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
45082024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
45092024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
45102024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45112024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
45122024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45132024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
45142024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45152024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45162024-08-22T03:19:53.242ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
45172024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
45182024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45192024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45202024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
45212024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45222024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45232024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
45242024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
45252024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
45262024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45272024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
45282024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45292024-08-22T03:19:53.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 761003403 } })
45302024-08-22T03:19:53.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 761045474 } })
45312024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45322024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45332024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45342024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45352024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45362024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45372024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45382024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45392024-08-22T03:19:53.243ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
45402024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45412024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
45422024-08-22T03:19:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45432024-08-22T03:19:53.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
45442024-08-22T03:19:53.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45452024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45462024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45472024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45482024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45492024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.221838ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
45502024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45512024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45522024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45532024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
45542024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45552024-08-22T03:19:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45562024-08-22T03:19:53.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45572024-08-22T03:19:53.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45582024-08-22T03:19:53.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45592024-08-22T03:19:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45602024-08-22T03:19:53.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.859239ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45612024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45622024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45632024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45642024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45652024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
45662024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45672024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
45682024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45692024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45702024-08-22T03:19:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45712024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45722024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45732024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45742024-08-22T03:19:53.248ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
45752024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
45762024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
45772024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45782024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45792024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45802024-08-22T03:19:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
45812024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
45822024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45832024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
45842024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45852024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45862024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.471151ms iteration = 16 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
45872024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45882024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.660214ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45892024-08-22T03:19:53.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 767704057 } })
45902024-08-22T03:19:53.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45912024-08-22T03:19:53.250ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
45922024-08-22T03:19:53.250ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
45932024-08-22T03:19:53.250ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 7.299371ms iteration = 16 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
45942024-08-22T03:19:53.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
45952024-08-22T03:19:53.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45962024-08-22T03:19:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45972024-08-22T03:19:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
45982024-08-22T03:19:53.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45992024-08-22T03:19:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46002024-08-22T03:19:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46012024-08-22T03:19:53.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46022024-08-22T03:19:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46032024-08-22T03:19:53.253ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
46042024-08-22T03:19:53.253ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 10.439301ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
46052024-08-22T03:19:53.254ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46062024-08-22T03:19:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46072024-08-22T03:19:53.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
46082024-08-22T03:19:53.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.227397ms iteration = 46 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
46092024-08-22T03:19:53.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46102024-08-22T03:19:53.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46112024-08-22T03:19:53.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46122024-08-22T03:19:53.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46132024-08-22T03:19:53.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46142024-08-22T03:19:53.264ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46152024-08-22T03:19:53.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46162024-08-22T03:19:53.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46172024-08-22T03:19:53.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46182024-08-22T03:19:53.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46192024-08-22T03:19:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46202024-08-22T03:19:53.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46212024-08-22T03:19:53.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46222024-08-22T03:19:53.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46232024-08-22T03:19:53.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46242024-08-22T03:19:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
46252024-08-22T03:19:53.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46262024-08-22T03:19:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46272024-08-22T03:19:53.270ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 27.096501ms iteration = 16 status = 0
46282024-08-22T03:19:53.282ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 40.862574ms iteration = 19 status = {"physical_disks_added":0}
46292024-08-22T03:19:53.389ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
46302024-08-22T03:19:53.389ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46312024-08-22T03:19:53.389ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c90a0b4c-8f66-4375-b4ad-1a62a8ccbeab", "content-length": "26", "date": "Thu, 22 Aug 2024 03:19:52 GMT"} })
46322024-08-22T03:19:53.389ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46332024-08-22T03:19:53.391ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
46342024-08-22T03:19:53.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
46352024-08-22T03:19:53.393ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46362024-08-22T03:19:53.394ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e47c437e-c0bc-4116-8bf3-8255dbc8b8c5", "content-length": "26", "date": "Thu, 22 Aug 2024 03:19:52 GMT"} })
46372024-08-22T03:19:53.394ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46382024-08-22T03:19:53.395ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46392024-08-22T03:19:53.415ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46402024-08-22T03:19:53.416ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "97041cb5-bf55-4b6c-9317-6c1c0e8c9c09", "content-length": "372", "date": "Thu, 22 Aug 2024 03:19:52 GMT"} })
46412024-08-22T03:19:53.416ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46422024-08-22T03:19:53.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46432024-08-22T03:19:53.418ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46442024-08-22T03:19:53.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46452024-08-22T03:19:53.420ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46462024-08-22T03:19:53.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46472024-08-22T03:19:53.421ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46482024-08-22T03:19:53.424ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "d20437df-9d70-4742-89c8-b98013bb8ec4", "date": "Thu, 22 Aug 2024 03:19:52 GMT"} })
46492024-08-22T03:19:53.425ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 182.96228ms iteration = 18 status = {}
46502024-08-22T03:19:53.478ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
46512024-08-22T03:19:53.478ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
46522024-08-22T03:19:53.478ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f27641ea-545a-4fd4-b208-4486dfc067b6", "content-length": "26", "date": "Thu, 22 Aug 2024 03:19:52 GMT"} })
46532024-08-22T03:19:53.478ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
46542024-08-22T03:19:53.481ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
46552024-08-22T03:19:53.500ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46562024-08-22T03:19:53.500ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b08346a3-5714-4237-90ad-7228239f4fba", "content-length": "691", "date": "Thu, 22 Aug 2024 03:19:52 GMT"} })
46572024-08-22T03:19:53.500ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
46582024-08-22T03:19:53.500ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
46592024-08-22T03:19:53.500ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
46602024-08-22T03:19:53.502ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 259.511473ms iteration = 17 status = {}
46612024-08-22T03:19:53.514ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 274.38823ms iteration = 16 status = {}
46622024-08-22T03:19:53.632ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46632024-08-22T03:19:53.632ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f80b978e-22df-4b6b-a040-6010ed1890c2", "content-length": "2", "date": "Thu, 22 Aug 2024 03:19:53 GMT"} })
46642024-08-22T03:19:53.634ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46652024-08-22T03:19:53.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46662024-08-22T03:19:53.636ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 396.614487ms iteration = 16 status = null
46672024-08-22T03:19:53.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46682024-08-22T03:19:53.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46692024-08-22T03:19:53.671ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
46702024-08-22T03:19:53.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46712024-08-22T03:19:53.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46722024-08-22T03:19:53.677ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46732024-08-22T03:19:53.678ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f871644e-a415-460d-821a-00eedb9b87db", "content-length": "121", "date": "Thu, 22 Aug 2024 03:19:53 GMT"} })
46742024-08-22T03:19:53.678ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
46752024-08-22T03:19:53.678ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
46762024-08-22T03:19:53.678ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46772024-08-22T03:19:53.678ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46782024-08-22T03:19:53.678ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
46792024-08-22T03:19:53.679ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
46802024-08-22T03:19:53.679ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
46812024-08-22T03:19:53.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46822024-08-22T03:19:53.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46832024-08-22T03:19:53.680ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46842024-08-22T03:19:53.680ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10692e18-a6cc-4f19-97cf-a79f0cb2602f", "content-length": "2", "date": "Thu, 22 Aug 2024 03:19:53 GMT"} })
46852024-08-22T03:19:53.680ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46862024-08-22T03:19:53.680ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6aee22fa-2a1a-4cba-9448-a79e5d1f0d54", "content-length": "51", "date": "Thu, 22 Aug 2024 03:19:53 GMT"} })
46872024-08-22T03:19:53.680ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
46882024-08-22T03:19:53.680ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46892024-08-22T03:19:53.771ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "04dd4928-d617-490a-bc62-d16522bf7c77", "date": "Thu, 22 Aug 2024 03:19:52 GMT"} })
46902024-08-22T03:19:53.771ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
46912024-08-22T03:19:53.771ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46922024-08-22T03:19:53.771ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54935483-275c-4d94-8ed8-4fc673bd2313", "content-length": "667", "date": "Thu, 22 Aug 2024 03:19:52 GMT"} })
46932024-08-22T03:19:53.771ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46942024-08-22T03:19:53.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46952024-08-22T03:19:53.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46962024-08-22T03:19:53.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46972024-08-22T03:19:53.777ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46982024-08-22T03:19:53.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46992024-08-22T03:19:53.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47002024-08-22T03:19:53.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47012024-08-22T03:19:53.784ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 541.614989ms iteration = 16 status = {}
47022024-08-22T03:19:53.986ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:40748
47032024-08-22T03:19:53.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40748 req_id = 8c8b7d2a-6450-4f4c-bd5d-4ab0d0c0f2e5 roles = RoleSet { roles: {} } uri = /metrics/producers
47042024-08-22T03:19:53.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40748 req_id = 8c8b7d2a-6450-4f4c-bd5d-4ab0d0c0f2e5 resource = Database result = Ok(()) uri = /metrics/producers
47052024-08-22T03:19:54.020ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
47062024-08-22T03:19:54.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40748 req_id = 8c8b7d2a-6450-4f4c-bd5d-4ab0d0c0f2e5 roles = RoleSet { roles: {} } uri = /metrics/producers
47072024-08-22T03:19:54.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40748 req_id = 8c8b7d2a-6450-4f4c-bd5d-4ab0d0c0f2e5 resource = Database result = Ok(()) uri = /metrics/producers
47082024-08-22T03:19:54.027ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
47092024-08-22T03:19:54.028ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1200bca8-1297-426f-bce4-0e8deced39b9", "date": "Thu, 22 Aug 2024 03:19:54 GMT"} })
47102024-08-22T03:19:54.028ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = e4d9dca8-f487-4ba1-85b6-d674be01f3cb
47112024-08-22T03:19:54.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43213 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:40748 req_id = 8c8b7d2a-6450-4f4c-bd5d-4ab0d0c0f2e5 response_code = 201 uri = /metrics/producers
47122024-08-22T03:19:54.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 676b841b-c2e0-4657-8e24-e89ac7a9eb1a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47132024-08-22T03:19:54.030ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 676b841b-c2e0-4657-8e24-e89ac7a9eb1a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47142024-08-22T03:19:54.032ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1893 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 676b841b-c2e0-4657-8e24-e89ac7a9eb1a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47152024-08-22T03:19:54.525ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 9a182756-451b-47d2-88b6-e440881fcc13 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
47162024-08-22T03:19:55.050ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:62287
47172024-08-22T03:19:55.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62287 req_id = e924fc78-dab9-4a68-9215-ab0385744fdf roles = RoleSet { roles: {} } uri = /metrics/producers
47182024-08-22T03:19:55.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62287 req_id = e924fc78-dab9-4a68-9215-ab0385744fdf resource = Database result = Ok(()) uri = /metrics/producers
47192024-08-22T03:19:55.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e0f3fdae-0c0e-415b-93c6-95d5460c0c93 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47202024-08-22T03:19:55.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e0f3fdae-0c0e-415b-93c6-95d5460c0c93 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47212024-08-22T03:19:55.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2071 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e0f3fdae-0c0e-415b-93c6-95d5460c0c93 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47222024-08-22T03:19:55.084ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
47232024-08-22T03:19:55.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62287 req_id = e924fc78-dab9-4a68-9215-ab0385744fdf roles = RoleSet { roles: {} } uri = /metrics/producers
47242024-08-22T03:19:55.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62287 req_id = e924fc78-dab9-4a68-9215-ab0385744fdf resource = Database result = Ok(()) uri = /metrics/producers
47252024-08-22T03:19:55.090ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
47262024-08-22T03:19:55.090ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "0490d447-bda2-4801-a11a-19bf626fff26", "date": "Thu, 22 Aug 2024 03:19:55 GMT"} })
47272024-08-22T03:19:55.090ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47282024-08-22T03:19:55.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 41834 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62287 req_id = e924fc78-dab9-4a68-9215-ab0385744fdf response_code = 201 uri = /metrics/producers
47292024-08-22T03:19:56.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cbe36e2e-9aef-4fb8-a5b0-56a5072b28ec roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47302024-08-22T03:19:56.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cbe36e2e-9aef-4fb8-a5b0-56a5072b28ec resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47312024-08-22T03:19:56.076ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2545 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cbe36e2e-9aef-4fb8-a5b0-56a5072b28ec response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47322024-08-22T03:19:56.528ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:59945
47332024-08-22T03:19:56.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59945 req_id = e871fa31-1bfe-4535-84b0-13eab00c840a roles = RoleSet { roles: {} } uri = /metrics/producers
47342024-08-22T03:19:56.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59945 req_id = e871fa31-1bfe-4535-84b0-13eab00c840a resource = Database result = Ok(()) uri = /metrics/producers
47352024-08-22T03:19:56.561ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
47362024-08-22T03:19:56.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59945 req_id = e871fa31-1bfe-4535-84b0-13eab00c840a roles = RoleSet { roles: {} } uri = /metrics/producers
47372024-08-22T03:19:56.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59945 req_id = e871fa31-1bfe-4535-84b0-13eab00c840a resource = Database result = Ok(()) uri = /metrics/producers
47382024-08-22T03:19:56.570ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
47392024-08-22T03:19:56.570ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ea01e609-8be5-4baa-bd69-5aa5fcde06c2", "date": "Thu, 22 Aug 2024 03:19:56 GMT"} })
47402024-08-22T03:19:56.570ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = 23048a74-7858-48f9-b45b-63d0f73fea5c
47412024-08-22T03:19:56.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42221 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:59945 req_id = e871fa31-1bfe-4535-84b0-13eab00c840a response_code = 201 uri = /metrics/producers
47422024-08-22T03:19:57.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 518ae552-4114-4d1f-a970-096175a30921 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47432024-08-22T03:19:57.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 518ae552-4114-4d1f-a970-096175a30921 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47442024-08-22T03:19:57.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2817 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 518ae552-4114-4d1f-a970-096175a30921 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47452024-08-22T03:19:57.509ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:37256
47462024-08-22T03:19:57.509ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37256 req_id = 0ef8b56d-15f0-407e-8020-63a32df8e839 roles = RoleSet { roles: {} } uri = /metrics/producers
47472024-08-22T03:19:57.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37256 req_id = 0ef8b56d-15f0-407e-8020-63a32df8e839 resource = Database result = Ok(()) uri = /metrics/producers
47482024-08-22T03:19:57.542ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
47492024-08-22T03:19:57.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37256 req_id = 0ef8b56d-15f0-407e-8020-63a32df8e839 roles = RoleSet { roles: {} } uri = /metrics/producers
47502024-08-22T03:19:57.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37256 req_id = 0ef8b56d-15f0-407e-8020-63a32df8e839 resource = Database result = Ok(()) uri = /metrics/producers
47512024-08-22T03:19:57.550ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
47522024-08-22T03:19:57.550ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "3c23747c-1a1c-4749-984f-93893e522738", "date": "Thu, 22 Aug 2024 03:19:57 GMT"} })
47532024-08-22T03:19:57.550ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = ce6ae16f-249c-4cde-9f29-e4f137631a2e
47542024-08-22T03:19:57.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 42001 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:37256 req_id = 0ef8b56d-15f0-407e-8020-63a32df8e839 response_code = 201 uri = /metrics/producers
47552024-08-22T03:19:58.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 038e35d1-f869-44a0-a53c-c0d4895f1367 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47562024-08-22T03:19:58.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 038e35d1-f869-44a0-a53c-c0d4895f1367 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47572024-08-22T03:19:58.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 038e35d1-f869-44a0-a53c-c0d4895f1367 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47582024-08-22T03:19:59.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = caea6c13-9f17-43da-9726-d3c78a49eb9b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47592024-08-22T03:19:59.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = caea6c13-9f17-43da-9726-d3c78a49eb9b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47602024-08-22T03:19:59.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = caea6c13-9f17-43da-9726-d3c78a49eb9b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47612024-08-22T03:19:59.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 8affe136-a40b-4334-b873-49e18c0e6380 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
47622024-08-22T03:19:59.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 8affe136-a40b-4334-b873-49e18c0e6380 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
47632024-08-22T03:19:59.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 8affe136-a40b-4334-b873-49e18c0e6380 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
47642024-08-22T03:20:00.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cfae463e-969d-44e8-9703-23f7f81ce559 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47652024-08-22T03:20:00.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cfae463e-969d-44e8-9703-23f7f81ce559 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47662024-08-22T03:20:00.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cfae463e-969d-44e8-9703-23f7f81ce559 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47672024-08-22T03:20:01.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b852e6d2-29fe-4d29-b3e8-e97673a019f5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47682024-08-22T03:20:01.181ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b852e6d2-29fe-4d29-b3e8-e97673a019f5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47692024-08-22T03:20:01.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b852e6d2-29fe-4d29-b3e8-e97673a019f5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47702024-08-22T03:20:02.130ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:51791
47712024-08-22T03:20:02.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51791 req_id = d8808e9f-c090-4650-804d-f5d788a18b91 roles = RoleSet { roles: {} } uri = /metrics/producers
47722024-08-22T03:20:02.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51791 req_id = d8808e9f-c090-4650-804d-f5d788a18b91 resource = Database result = Ok(()) uri = /metrics/producers
47732024-08-22T03:20:02.163ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
47742024-08-22T03:20:02.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51791 req_id = d8808e9f-c090-4650-804d-f5d788a18b91 roles = RoleSet { roles: {} } uri = /metrics/producers
47752024-08-22T03:20:02.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51791 req_id = d8808e9f-c090-4650-804d-f5d788a18b91 resource = Database result = Ok(()) uri = /metrics/producers
47762024-08-22T03:20:02.168ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
47772024-08-22T03:20:02.168ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9f10a557-fcd8-4a1e-8934-f061ece0075c", "date": "Thu, 22 Aug 2024 03:20:02 GMT"} })
47782024-08-22T03:20:02.168ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = b136e605-e6c0-4cdf-94cc-94880650b9fc
47792024-08-22T03:20:02.170ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40001 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51791 req_id = d8808e9f-c090-4650-804d-f5d788a18b91 response_code = 201 uri = /metrics/producers
47802024-08-22T03:20:02.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5f505cc8-cb49-43a7-98f5-13937e4b5156 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47812024-08-22T03:20:02.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5f505cc8-cb49-43a7-98f5-13937e4b5156 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47822024-08-22T03:20:02.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5f505cc8-cb49-43a7-98f5-13937e4b5156 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47832024-08-22T03:20:03.221ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9ad6da63-5809-4fc1-9f80-5dfed2294000 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47842024-08-22T03:20:03.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9ad6da63-5809-4fc1-9f80-5dfed2294000 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47852024-08-22T03:20:03.223ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9ad6da63-5809-4fc1-9f80-5dfed2294000 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
47862024-08-22T03:20:03.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
47872024-08-22T03:20:03.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47882024-08-22T03:20:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47892024-08-22T03:20:03.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47902024-08-22T03:20:03.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
47912024-08-22T03:20:03.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47922024-08-22T03:20:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47932024-08-22T03:20:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47942024-08-22T03:20:03.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47952024-08-22T03:20:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47962024-08-22T03:20:03.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47972024-08-22T03:20:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47982024-08-22T03:20:03.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47992024-08-22T03:20:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48002024-08-22T03:20:03.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.150559ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48012024-08-22T03:20:03.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48022024-08-22T03:20:03.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
48032024-08-22T03:20:03.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48042024-08-22T03:20:03.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48052024-08-22T03:20:03.255ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
48062024-08-22T03:20:03.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.897247ms iteration = 47 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
48072024-08-22T03:20:04.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 499a151e-97c1-4ea6-946b-f06be329e6a3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48082024-08-22T03:20:04.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 499a151e-97c1-4ea6-946b-f06be329e6a3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48092024-08-22T03:20:04.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2929 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 499a151e-97c1-4ea6-946b-f06be329e6a3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48102024-08-22T03:20:04.526ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1748 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = fe7e2989-7716-4346-8a95-1fc0ab317c4d response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
48112024-08-22T03:20:05.263ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 67990c9a-869f-4b63-ace8-3b824b4f51e4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48122024-08-22T03:20:05.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 67990c9a-869f-4b63-ace8-3b824b4f51e4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48132024-08-22T03:20:05.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 67990c9a-869f-4b63-ace8-3b824b4f51e4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48142024-08-22T03:20:06.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7df1ad0c-c0a3-4b1a-8b81-f2145f590720 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48152024-08-22T03:20:06.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7df1ad0c-c0a3-4b1a-8b81-f2145f590720 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48162024-08-22T03:20:06.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7df1ad0c-c0a3-4b1a-8b81-f2145f590720 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48172024-08-22T03:20:07.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 90db7d4a-5e8c-4521-96fa-b70093417078 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48182024-08-22T03:20:07.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 90db7d4a-5e8c-4521-96fa-b70093417078 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48192024-08-22T03:20:07.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 90db7d4a-5e8c-4521-96fa-b70093417078 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48202024-08-22T03:20:08.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3afdca65-e907-4dd1-9569-0c605de3e430 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48212024-08-22T03:20:08.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3afdca65-e907-4dd1-9569-0c605de3e430 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48222024-08-22T03:20:08.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3afdca65-e907-4dd1-9569-0c605de3e430 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48232024-08-22T03:20:09.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0446c095-e946-4ff4-b4da-e6542aa6e591 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48242024-08-22T03:20:09.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0446c095-e946-4ff4-b4da-e6542aa6e591 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48252024-08-22T03:20:09.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0446c095-e946-4ff4-b4da-e6542aa6e591 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48262024-08-22T03:20:10.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 181416df-e3c6-4201-9d06-b3d26d363a47 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48272024-08-22T03:20:10.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 181416df-e3c6-4201-9d06-b3d26d363a47 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48282024-08-22T03:20:10.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2966 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 181416df-e3c6-4201-9d06-b3d26d363a47 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48292024-08-22T03:20:11.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1d338f5c-002b-4fbe-a5e3-939f8b704c14 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48302024-08-22T03:20:11.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1d338f5c-002b-4fbe-a5e3-939f8b704c14 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48312024-08-22T03:20:11.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2806 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1d338f5c-002b-4fbe-a5e3-939f8b704c14 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48322024-08-22T03:20:12.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5066b3aa-0014-4de3-b364-12f264f2d086 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48332024-08-22T03:20:12.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5066b3aa-0014-4de3-b364-12f264f2d086 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48342024-08-22T03:20:12.414ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5066b3aa-0014-4de3-b364-12f264f2d086 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48352024-08-22T03:20:13.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
48362024-08-22T03:20:13.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48372024-08-22T03:20:13.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48382024-08-22T03:20:13.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48392024-08-22T03:20:13.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
48402024-08-22T03:20:13.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48412024-08-22T03:20:13.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48422024-08-22T03:20:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48432024-08-22T03:20:13.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48442024-08-22T03:20:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48452024-08-22T03:20:13.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48462024-08-22T03:20:13.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48472024-08-22T03:20:13.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48482024-08-22T03:20:13.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48492024-08-22T03:20:13.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.17074ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48502024-08-22T03:20:13.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48512024-08-22T03:20:13.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
48522024-08-22T03:20:13.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48532024-08-22T03:20:13.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48542024-08-22T03:20:13.254ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
48552024-08-22T03:20:13.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.643734ms iteration = 48 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
48562024-08-22T03:20:13.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c0c09b7-3d04-42b5-88e8-1dbd179f345e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48572024-08-22T03:20:13.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c0c09b7-3d04-42b5-88e8-1dbd179f345e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48582024-08-22T03:20:13.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1769 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5c0c09b7-3d04-42b5-88e8-1dbd179f345e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48592024-08-22T03:20:14.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4ff28ce4-2d85-4823-be8e-a03db61f4ce1 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48602024-08-22T03:20:14.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4ff28ce4-2d85-4823-be8e-a03db61f4ce1 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48612024-08-22T03:20:14.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4ff28ce4-2d85-4823-be8e-a03db61f4ce1 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48622024-08-22T03:20:14.526ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1723 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = e000b8e9-39fb-4785-97de-a5c10d5bd23e response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
48632024-08-22T03:20:15.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f286d8e-b152-424e-97ed-b458dcf5f289 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48642024-08-22T03:20:15.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f286d8e-b152-424e-97ed-b458dcf5f289 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48652024-08-22T03:20:15.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8f286d8e-b152-424e-97ed-b458dcf5f289 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48662024-08-22T03:20:16.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1762429d-e833-4ca5-b5f1-d61919577214 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48672024-08-22T03:20:16.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1762429d-e833-4ca5-b5f1-d61919577214 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48682024-08-22T03:20:16.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1762429d-e833-4ca5-b5f1-d61919577214 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48692024-08-22T03:20:17.518ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 549d093c-262a-40e6-8874-104e89e6d80f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48702024-08-22T03:20:17.518ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 549d093c-262a-40e6-8874-104e89e6d80f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48712024-08-22T03:20:17.520ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 549d093c-262a-40e6-8874-104e89e6d80f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48722024-08-22T03:20:18.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 98b4ba3a-df52-467b-81b9-b4916dd5a023 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48732024-08-22T03:20:18.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 98b4ba3a-df52-467b-81b9-b4916dd5a023 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48742024-08-22T03:20:18.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2202 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 98b4ba3a-df52-467b-81b9-b4916dd5a023 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48752024-08-22T03:20:19.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b68bb747-bc47-44b3-8e4b-ba9e9774f1c0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48762024-08-22T03:20:19.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b68bb747-bc47-44b3-8e4b-ba9e9774f1c0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48772024-08-22T03:20:19.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b68bb747-bc47-44b3-8e4b-ba9e9774f1c0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48782024-08-22T03:20:20.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 118ca060-0cc8-48b9-9858-e9f75a52ff2b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48792024-08-22T03:20:20.583ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 118ca060-0cc8-48b9-9858-e9f75a52ff2b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48802024-08-22T03:20:20.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2050 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 118ca060-0cc8-48b9-9858-e9f75a52ff2b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48812024-08-22T03:20:21.602ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b538dfb8-4536-4bc5-94e3-3bf4273777e9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48822024-08-22T03:20:21.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b538dfb8-4536-4bc5-94e3-3bf4273777e9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48832024-08-22T03:20:21.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b538dfb8-4536-4bc5-94e3-3bf4273777e9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48842024-08-22T03:20:22.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5e1e3fde-0af2-45e0-96fb-9d238645da8e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48852024-08-22T03:20:22.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5e1e3fde-0af2-45e0-96fb-9d238645da8e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48862024-08-22T03:20:22.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5e1e3fde-0af2-45e0-96fb-9d238645da8e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
48872024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
48882024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
48892024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
48902024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
48912024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
48922024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
48932024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
48942024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
48952024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
48962024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48972024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
48982024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48992024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
49002024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49012024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
49022024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
49032024-08-22T03:20:23.240ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = bff907f0-2101-418e-8f5d-955661c8bd6f
49042024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.83\u{b5}s iteration = 10 status = {"error":"blueprint disabled","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f"}
49052024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
49062024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
49072024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
49082024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49092024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
49102024-08-22T03:20:23.240ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-22 03:10:23.240618471 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49112024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49122024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49132024-08-22T03:20:23.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49142024-08-22T03:20:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49152024-08-22T03:20:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49162024-08-22T03:20:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49172024-08-22T03:20:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
49182024-08-22T03:20:23.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49192024-08-22T03:20:23.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
49202024-08-22T03:20:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
49212024-08-22T03:20:23.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3ce7517f-82f9-4849-ad08-7cb0bf67f024.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 759517191 } })
49222024-08-22T03:20:23.242ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1467044e-2fe8-4015-be86-a3faa36f1469.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64fff417-46fd-44ed-ac7e-a3829d9efa54.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 759572701 } })
49232024-08-22T03:20:23.242ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
49242024-08-22T03:20:23.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49252024-08-22T03:20:23.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
49262024-08-22T03:20:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49272024-08-22T03:20:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
49282024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.519612ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49292024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49302024-08-22T03:20:23.243ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-22 03:10:23.240618471 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
49312024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
49322024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 2.740044ms iteration = 9 status = {"expiration":"2024-08-22T03:10:23.240618471Z","pruned":[]}
49332024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
49342024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
49352024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49362024-08-22T03:20:23.243ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49372024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49382024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49392024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
49402024-08-22T03:20:23.243ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
49412024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
49422024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
49432024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49442024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
49452024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49462024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
49472024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49482024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
49492024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
49502024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49512024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49522024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
49532024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49542024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49552024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
49562024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
49572024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
49582024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49592024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
49602024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49612024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49622024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49632024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
49642024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49652024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
49662024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49672024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49682024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49692024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49702024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49712024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
49722024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.375582ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
49732024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
49742024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49752024-08-22T03:20:23.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49762024-08-22T03:20:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49772024-08-22T03:20:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49782024-08-22T03:20:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49792024-08-22T03:20:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49802024-08-22T03:20:23.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 762469758 } })
49812024-08-22T03:20:23.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49822024-08-22T03:20:23.245ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
49832024-08-22T03:20:23.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 762531908 } })
49842024-08-22T03:20:23.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.664819ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
49852024-08-22T03:20:23.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49862024-08-22T03:20:23.245ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 1.971205ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
49872024-08-22T03:20:23.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
49882024-08-22T03:20:23.246ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
49892024-08-22T03:20:23.246ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
49902024-08-22T03:20:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 2.755275ms iteration = 9 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
49912024-08-22T03:20:23.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
49922024-08-22T03:20:23.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
49932024-08-22T03:20:23.246ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49942024-08-22T03:20:23.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49952024-08-22T03:20:23.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49962024-08-22T03:20:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
49972024-08-22T03:20:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.279531ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
49982024-08-22T03:20:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49992024-08-22T03:20:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50002024-08-22T03:20:23.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50012024-08-22T03:20:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50022024-08-22T03:20:23.247ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50032024-08-22T03:20:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50042024-08-22T03:20:23.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.808541ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50052024-08-22T03:20:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50062024-08-22T03:20:23.248ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50072024-08-22T03:20:23.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50082024-08-22T03:20:23.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50092024-08-22T03:20:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50102024-08-22T03:20:23.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50112024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50122024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50132024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50142024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50152024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50162024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50172024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50182024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50192024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
50202024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
50212024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
50222024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50232024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50242024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50252024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50262024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50272024-08-22T03:20:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50282024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50292024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50302024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50312024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50322024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
50332024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
50342024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
50352024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50362024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50372024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.234602ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50382024-08-22T03:20:23.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50392024-08-22T03:20:23.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50402024-08-22T03:20:23.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50412024-08-22T03:20:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50422024-08-22T03:20:23.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 8.294294ms iteration = 17 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
50432024-08-22T03:20:23.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50442024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
50452024-08-22T03:20:23.252ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
50462024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 8.815551ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
50472024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50482024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50492024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
50502024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50512024-08-22T03:20:23.252ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
50522024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50532024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50542024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50552024-08-22T03:20:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50562024-08-22T03:20:23.253ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50572024-08-22T03:20:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50582024-08-22T03:20:23.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50592024-08-22T03:20:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50602024-08-22T03:20:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50612024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50622024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50632024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50642024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50652024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50662024-08-22T03:20:23.254ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
50672024-08-22T03:20:23.254ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50682024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 11.221471ms iteration = 17 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
50692024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50702024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
50712024-08-22T03:20:23.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50722024-08-22T03:20:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50732024-08-22T03:20:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
50742024-08-22T03:20:23.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50752024-08-22T03:20:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50762024-08-22T03:20:23.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50772024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
50782024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50792024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
50802024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50812024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50822024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50832024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
50842024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 0 version = 2
50852024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50862024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50872024-08-22T03:20:23.256ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50882024-08-22T03:20:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50892024-08-22T03:20:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50902024-08-22T03:20:23.257ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50912024-08-22T03:20:23.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50922024-08-22T03:20:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50932024-08-22T03:20:23.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50942024-08-22T03:20:23.258ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
50952024-08-22T03:20:23.258ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
50962024-08-22T03:20:23.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50972024-08-22T03:20:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50982024-08-22T03:20:23.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50992024-08-22T03:20:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51002024-08-22T03:20:23.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51012024-08-22T03:20:23.259ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 776826168 } })
51022024-08-22T03:20:23.259ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
51032024-08-22T03:20:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51042024-08-22T03:20:23.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51052024-08-22T03:20:23.260ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51062024-08-22T03:20:23.260ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.150165ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51072024-08-22T03:20:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51082024-08-22T03:20:23.261ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 19.04905ms iteration = 20 status = {"physical_disks_added":0}
51092024-08-22T03:20:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51102024-08-22T03:20:23.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51112024-08-22T03:20:23.261ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 1 version = 2
51122024-08-22T03:20:23.261ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
51132024-08-22T03:20:23.261ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-22 03:13:03.125979 UTC dns_group = external generation = 2
51142024-08-22T03:20:23.261ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 21.329558ms iteration = 10 status = {"generation":2}
51152024-08-22T03:20:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51162024-08-22T03:20:23.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
51172024-08-22T03:20:23.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.386042ms iteration = 49 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
51182024-08-22T03:20:23.263ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
51192024-08-22T03:20:23.263ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
51202024-08-22T03:20:23.263ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-22 03:13:02.692706 UTC dns_group = internal generation = 1
51212024-08-22T03:20:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 23.504245ms iteration = 10 status = {"generation":1}
51222024-08-22T03:20:23.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51232024-08-22T03:20:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51242024-08-22T03:20:23.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51252024-08-22T03:20:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51262024-08-22T03:20:23.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51272024-08-22T03:20:23.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51282024-08-22T03:20:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51292024-08-22T03:20:23.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51302024-08-22T03:20:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
51312024-08-22T03:20:23.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51322024-08-22T03:20:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51332024-08-22T03:20:23.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51342024-08-22T03:20:23.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51352024-08-22T03:20:23.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51362024-08-22T03:20:23.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51372024-08-22T03:20:23.269ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 26.562094ms iteration = 17 status = 0
51382024-08-22T03:20:23.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51392024-08-22T03:20:23.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51402024-08-22T03:20:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51412024-08-22T03:20:23.306ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-22T03:12:22.052278Z, time_modified: 2024-08-22T03:12:22.052278Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }) }
51422024-08-22T03:20:23.306ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 66.203693ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]}},"default_endpoint":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
51432024-08-22T03:20:23.423ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
51442024-08-22T03:20:23.423ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51452024-08-22T03:20:23.423ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "c036b1ea-4612-498d-b65d-91b6fe71eb98", "content-length": "26", "date": "Thu, 22 Aug 2024 03:20:22 GMT"} })
51462024-08-22T03:20:23.423ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51472024-08-22T03:20:23.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51482024-08-22T03:20:23.478ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51492024-08-22T03:20:23.478ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ca16af63-c5c2-406c-9738-d19e47ee2b89", "content-length": "372", "date": "Thu, 22 Aug 2024 03:20:22 GMT"} })
51502024-08-22T03:20:23.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51512024-08-22T03:20:23.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51522024-08-22T03:20:23.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51532024-08-22T03:20:23.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51542024-08-22T03:20:23.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51552024-08-22T03:20:23.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51562024-08-22T03:20:23.484ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51572024-08-22T03:20:23.485ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6c89e748-590d-4b65-bdd0-f9cf81277e1b", "date": "Thu, 22 Aug 2024 03:20:22 GMT"} })
51582024-08-22T03:20:23.486ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 242.917664ms iteration = 19 status = {}
51592024-08-22T03:20:23.509ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51602024-08-22T03:20:23.509ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8c3b0f87-fe3a-4497-bd9e-641353fe5f70", "content-length": "691", "date": "Thu, 22 Aug 2024 03:20:22 GMT"} })
51612024-08-22T03:20:23.509ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51622024-08-22T03:20:23.509ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51632024-08-22T03:20:23.509ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51642024-08-22T03:20:23.511ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 268.510146ms iteration = 18 status = {}
51652024-08-22T03:20:23.566ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
51662024-08-22T03:20:23.566ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51672024-08-22T03:20:23.566ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "501c33b5-b817-43b8-832b-5f317bb7b831", "content-length": "26", "date": "Thu, 22 Aug 2024 03:20:22 GMT"} })
51682024-08-22T03:20:23.566ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51692024-08-22T03:20:23.569ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
51702024-08-22T03:20:23.595ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
51712024-08-22T03:20:23.595ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
51722024-08-22T03:20:23.595ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "08c4f3a3-d5a0-462b-9c97-46e50e885afa", "content-length": "26", "date": "Thu, 22 Aug 2024 03:20:22 GMT"} })
51732024-08-22T03:20:23.595ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
51742024-08-22T03:20:23.597ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
51752024-08-22T03:20:23.617ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
51762024-08-22T03:20:23.641ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
51772024-08-22T03:20:23.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f5947aca-1a5d-4617-8653-ee5c4b32a18b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
51782024-08-22T03:20:23.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f5947aca-1a5d-4617-8653-ee5c4b32a18b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
51792024-08-22T03:20:23.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f5947aca-1a5d-4617-8653-ee5c4b32a18b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
51802024-08-22T03:20:23.732ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 492.36134ms iteration = 17 status = {}
51812024-08-22T03:20:23.818ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51822024-08-22T03:20:23.818ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "94539494-cba6-403c-a862-e1c7c9c465f5", "content-length": "2", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} })
51832024-08-22T03:20:23.820ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51842024-08-22T03:20:23.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51852024-08-22T03:20:23.822ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 582.090208ms iteration = 17 status = null
51862024-08-22T03:20:23.923ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
51872024-08-22T03:20:23.924ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
51882024-08-22T03:20:23.924ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "5cf1102d-8a1e-4aa6-b163-5ecc83291414", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51892024-08-22T03:20:23.924ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51902024-08-22T03:20:23.925ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1606f248-5bcc-4bc5-b133-43cf016e4249", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51912024-08-22T03:20:23.926ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51922024-08-22T03:20:23.927ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
51932024-08-22T03:20:23.927ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 687.189319ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
51942024-08-22T03:20:23.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51952024-08-22T03:20:23.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51962024-08-22T03:20:23.953ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
51972024-08-22T03:20:23.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51982024-08-22T03:20:23.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51992024-08-22T03:20:23.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
52002024-08-22T03:20:23.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1aad1ec7-edd6-4357-9e70-b3714ab3df9d", "content-length": "121", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} })
52012024-08-22T03:20:23.962ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
52022024-08-22T03:20:23.962ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
52032024-08-22T03:20:23.962ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52042024-08-22T03:20:23.962ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
52052024-08-22T03:20:23.962ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
52062024-08-22T03:20:23.962ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
52072024-08-22T03:20:23.962ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
52082024-08-22T03:20:23.962ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52092024-08-22T03:20:23.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52102024-08-22T03:20:23.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
52112024-08-22T03:20:23.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6524cb15-91bf-4ac9-91e8-398211818baf", "content-length": "2", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} })
52122024-08-22T03:20:23.964ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
52132024-08-22T03:20:23.964ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a507f6fb-74e9-45ce-81a9-a6b1c74d8908", "content-length": "51", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} })
52142024-08-22T03:20:23.964ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
52152024-08-22T03:20:23.964ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
52162024-08-22T03:20:23.968ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
52172024-08-22T03:20:23.969ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7f0909c8-7c6a-46f5-8923-eef50dd104a5", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
52182024-08-22T03:20:23.969ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
52192024-08-22T03:20:23.971ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "dd884048-4fc4-4a28-8cae-0d956ec6922a", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
52202024-08-22T03:20:23.971ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
52212024-08-22T03:20:23.972ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "cbbafe12-e241-44b0-8a48-3d5f0c64f2fa", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
52222024-08-22T03:20:23.972ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
52232024-08-22T03:20:23.974ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
52242024-08-22T03:20:23.975ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 734.431663ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
52252024-08-22T03:20:24.052ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "126d74e6-75f9-4825-a655-648074ba31b3", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} })
52262024-08-22T03:20:24.052ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
52272024-08-22T03:20:24.052ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
52282024-08-22T03:20:24.054ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "29f40fa1-5782-4e9c-a8ca-f297b023ab67", "content-length": "667", "date": "Thu, 22 Aug 2024 03:20:23 GMT"} })
52292024-08-22T03:20:24.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52302024-08-22T03:20:24.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52312024-08-22T03:20:24.058ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52322024-08-22T03:20:24.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52332024-08-22T03:20:24.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52342024-08-22T03:20:24.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52352024-08-22T03:20:24.062ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52362024-08-22T03:20:24.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52372024-08-22T03:20:24.069ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 826.499791ms iteration = 17 status = {}
52382024-08-22T03:20:24.526ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1743 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = f9362a11-62b0-4330-9b66-aace6d71ca05 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
52392024-08-22T03:20:24.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 14cd3da4-80d9-4825-a938-1f43ca5fa94c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52402024-08-22T03:20:24.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 14cd3da4-80d9-4825-a938-1f43ca5fa94c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52412024-08-22T03:20:24.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 14cd3da4-80d9-4825-a938-1f43ca5fa94c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52422024-08-22T03:20:25.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = de7ef46f-f415-4734-b623-86a5b5bd8cfe roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52432024-08-22T03:20:25.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = de7ef46f-f415-4734-b623-86a5b5bd8cfe resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52442024-08-22T03:20:25.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = de7ef46f-f415-4734-b623-86a5b5bd8cfe response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52452024-08-22T03:20:26.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 84369352-3ad1-4487-a64c-893827fadaea roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52462024-08-22T03:20:26.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 84369352-3ad1-4487-a64c-893827fadaea resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52472024-08-22T03:20:26.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2604 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 84369352-3ad1-4487-a64c-893827fadaea response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52482024-08-22T03:20:27.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 144a1690-f08e-42b0-889f-c95d044894e8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52492024-08-22T03:20:27.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 144a1690-f08e-42b0-889f-c95d044894e8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52502024-08-22T03:20:27.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 144a1690-f08e-42b0-889f-c95d044894e8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52512024-08-22T03:20:28.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7c2f11d-54d8-4031-98cf-7b090f6964c7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52522024-08-22T03:20:28.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7c2f11d-54d8-4031-98cf-7b090f6964c7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52532024-08-22T03:20:28.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c7c2f11d-54d8-4031-98cf-7b090f6964c7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52542024-08-22T03:20:29.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c5128deb-74ee-4e7e-997a-b6a9880a46e2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52552024-08-22T03:20:29.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c5128deb-74ee-4e7e-997a-b6a9880a46e2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52562024-08-22T03:20:29.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c5128deb-74ee-4e7e-997a-b6a9880a46e2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52572024-08-22T03:20:29.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 2b96b6eb-63c7-4de6-b011-0c2acb6396bb roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
52582024-08-22T03:20:29.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 2b96b6eb-63c7-4de6-b011-0c2acb6396bb resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
52592024-08-22T03:20:29.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 2b96b6eb-63c7-4de6-b011-0c2acb6396bb response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
52602024-08-22T03:20:30.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e31b9a42-3a4f-450a-9b13-26bdbf65edfc roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52612024-08-22T03:20:30.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e31b9a42-3a4f-450a-9b13-26bdbf65edfc resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52622024-08-22T03:20:30.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e31b9a42-3a4f-450a-9b13-26bdbf65edfc response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52632024-08-22T03:20:31.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 76e0f084-cbeb-4722-8295-459d47cef986 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52642024-08-22T03:20:31.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 76e0f084-cbeb-4722-8295-459d47cef986 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52652024-08-22T03:20:31.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2295 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 76e0f084-cbeb-4722-8295-459d47cef986 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52662024-08-22T03:20:32.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4f66684c-8fcf-4cea-b3e1-5cf2a616318f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52672024-08-22T03:20:32.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4f66684c-8fcf-4cea-b3e1-5cf2a616318f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52682024-08-22T03:20:32.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4f66684c-8fcf-4cea-b3e1-5cf2a616318f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52692024-08-22T03:20:33.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
52702024-08-22T03:20:33.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52712024-08-22T03:20:33.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52722024-08-22T03:20:33.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732024-08-22T03:20:33.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
52742024-08-22T03:20:33.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52752024-08-22T03:20:33.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52762024-08-22T03:20:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52772024-08-22T03:20:33.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52782024-08-22T03:20:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52792024-08-22T03:20:33.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52802024-08-22T03:20:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52812024-08-22T03:20:33.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52822024-08-22T03:20:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52832024-08-22T03:20:33.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.386993ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52842024-08-22T03:20:33.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52852024-08-22T03:20:33.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
52862024-08-22T03:20:33.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52872024-08-22T03:20:33.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52882024-08-22T03:20:33.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
52892024-08-22T03:20:33.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.886307ms iteration = 50 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
52902024-08-22T03:20:33.858ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9075bdb-6842-4884-b5fc-5877a9bfb64a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52912024-08-22T03:20:33.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9075bdb-6842-4884-b5fc-5877a9bfb64a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52922024-08-22T03:20:33.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b9075bdb-6842-4884-b5fc-5877a9bfb64a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
52932024-08-22T03:20:34.526ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1856 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 7c550fc4-3a75-4612-a50e-1d0ee3596f6b response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
52942024-08-22T03:20:34.526ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
52952024-08-22T03:20:34.526ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
52962024-08-22T03:20:34.556ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
52972024-08-22T03:20:34.557ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:61773
52982024-08-22T03:20:34.557ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61773 req_id = b16cc0da-dad7-42b1-a12f-0f48c155c88a roles = RoleSet { roles: {} } uri = /metrics/producers
52992024-08-22T03:20:34.557ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61773 req_id = b16cc0da-dad7-42b1-a12f-0f48c155c88a resource = Database result = Ok(()) uri = /metrics/producers
53002024-08-22T03:20:34.590ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
53012024-08-22T03:20:34.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61773 req_id = b16cc0da-dad7-42b1-a12f-0f48c155c88a roles = RoleSet { roles: {} } uri = /metrics/producers
53022024-08-22T03:20:34.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61773 req_id = b16cc0da-dad7-42b1-a12f-0f48c155c88a resource = Database result = Ok(()) uri = /metrics/producers
53032024-08-22T03:20:34.596ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
53042024-08-22T03:20:34.596ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4fa6b12e-f921-41aa-9e41-6661e2ce58a3", "date": "Thu, 22 Aug 2024 03:20:34 GMT"} })
53052024-08-22T03:20:34.596ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = 3402f0c0-4afe-4d3a-ad22-fcd268662ca5
53062024-08-22T03:20:34.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40272 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:61773 req_id = b16cc0da-dad7-42b1-a12f-0f48c155c88a response_code = 201 uri = /metrics/producers
53072024-08-22T03:20:34.597ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::b)), port: Some(12221), path: "/metrics/producers", query: None, fragment: None }, status: 201, headers: {"content-type": "application/json", "x-request-id": "b16cc0da-dad7-42b1-a12f-0f48c155c88a", "content-length": "41", "date": "Thu, 22 Aug 2024 03:20:34 GMT"} })
53082024-08-22T03:20:34.598ZDEBGnexus (producer-registration-task): registered with nexus successfully
53092024-08-22T03:20:34.598ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
53102024-08-22T03:20:34.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df01f7ef-6019-4f7f-8365-d51ff4c5dd6b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53112024-08-22T03:20:34.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df01f7ef-6019-4f7f-8365-d51ff4c5dd6b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53122024-08-22T03:20:34.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = df01f7ef-6019-4f7f-8365-d51ff4c5dd6b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53132024-08-22T03:20:35.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 218fcfd1-066a-49d1-846e-7eb8d638b239 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53142024-08-22T03:20:35.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 218fcfd1-066a-49d1-846e-7eb8d638b239 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53152024-08-22T03:20:35.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1925 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 218fcfd1-066a-49d1-846e-7eb8d638b239 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53162024-08-22T03:20:36.921ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 30544668-4808-42b2-aebf-e0d17e4b2a1f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53172024-08-22T03:20:36.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 30544668-4808-42b2-aebf-e0d17e4b2a1f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53182024-08-22T03:20:36.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 30544668-4808-42b2-aebf-e0d17e4b2a1f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53192024-08-22T03:20:37.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4740a8a7-a065-46b0-8f8a-d218ea5a2854 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53202024-08-22T03:20:37.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4740a8a7-a065-46b0-8f8a-d218ea5a2854 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53212024-08-22T03:20:37.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4740a8a7-a065-46b0-8f8a-d218ea5a2854 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53222024-08-22T03:20:38.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fa579454-4fef-49b9-bc06-bb28109498e1 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53232024-08-22T03:20:38.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fa579454-4fef-49b9-bc06-bb28109498e1 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53242024-08-22T03:20:38.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fa579454-4fef-49b9-bc06-bb28109498e1 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53252024-08-22T03:20:39.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 221c8b99-881a-4b4e-aa67-64b0aea1f549 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53262024-08-22T03:20:39.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 221c8b99-881a-4b4e-aa67-64b0aea1f549 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53272024-08-22T03:20:39.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 221c8b99-881a-4b4e-aa67-64b0aea1f549 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53282024-08-22T03:20:41.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18b8b6be-01ed-46d8-9885-1acf1d7bab29 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53292024-08-22T03:20:41.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18b8b6be-01ed-46d8-9885-1acf1d7bab29 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53302024-08-22T03:20:41.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 18b8b6be-01ed-46d8-9885-1acf1d7bab29 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53312024-08-22T03:20:42.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a462dfe-4dbf-4518-a450-a97dadda72c9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53322024-08-22T03:20:42.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a462dfe-4dbf-4518-a450-a97dadda72c9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53332024-08-22T03:20:42.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a462dfe-4dbf-4518-a450-a97dadda72c9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53342024-08-22T03:20:43.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 286bdc31-719a-4d73-b458-793d643ea5f9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53352024-08-22T03:20:43.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 286bdc31-719a-4d73-b458-793d643ea5f9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53362024-08-22T03:20:43.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2462 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 286bdc31-719a-4d73-b458-793d643ea5f9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53372024-08-22T03:20:43.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
53382024-08-22T03:20:43.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53392024-08-22T03:20:43.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53402024-08-22T03:20:43.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53412024-08-22T03:20:43.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
53422024-08-22T03:20:43.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53432024-08-22T03:20:43.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53442024-08-22T03:20:43.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53452024-08-22T03:20:43.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53462024-08-22T03:20:43.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53472024-08-22T03:20:43.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53482024-08-22T03:20:43.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53492024-08-22T03:20:43.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53502024-08-22T03:20:43.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53512024-08-22T03:20:43.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.588335ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53522024-08-22T03:20:43.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53532024-08-22T03:20:43.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
53542024-08-22T03:20:43.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53552024-08-22T03:20:43.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53562024-08-22T03:20:43.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
53572024-08-22T03:20:43.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.677127ms iteration = 51 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
53582024-08-22T03:20:44.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f17a5e7e-8eb4-483f-bc54-3a7420bbd467 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53592024-08-22T03:20:44.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f17a5e7e-8eb4-483f-bc54-3a7420bbd467 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53602024-08-22T03:20:44.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = f17a5e7e-8eb4-483f-bc54-3a7420bbd467 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53612024-08-22T03:20:44.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = fa954ed2-4f14-485b-9f8a-c60347753346 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
53622024-08-22T03:20:45.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7091c761-a0c3-4253-b439-3fcffa52a63a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53632024-08-22T03:20:45.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7091c761-a0c3-4253-b439-3fcffa52a63a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53642024-08-22T03:20:45.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2570 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7091c761-a0c3-4253-b439-3fcffa52a63a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53652024-08-22T03:20:46.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6b61bf6b-e69b-4654-947a-2020161d7a72 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53662024-08-22T03:20:46.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6b61bf6b-e69b-4654-947a-2020161d7a72 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53672024-08-22T03:20:46.119ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6b61bf6b-e69b-4654-947a-2020161d7a72 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53682024-08-22T03:20:47.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f5193bc-3566-4e93-8be1-16469fff6a33 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53692024-08-22T03:20:47.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f5193bc-3566-4e93-8be1-16469fff6a33 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53702024-08-22T03:20:47.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f5193bc-3566-4e93-8be1-16469fff6a33 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53712024-08-22T03:20:48.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 206c711d-28fe-4346-81c8-40192c656e65 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53722024-08-22T03:20:48.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 206c711d-28fe-4346-81c8-40192c656e65 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53732024-08-22T03:20:48.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2226 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 206c711d-28fe-4346-81c8-40192c656e65 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53742024-08-22T03:20:49.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = efc7840d-c4c2-4494-9630-ddb70f31c6ac roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53752024-08-22T03:20:49.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = efc7840d-c4c2-4494-9630-ddb70f31c6ac resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53762024-08-22T03:20:49.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2110 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = efc7840d-c4c2-4494-9630-ddb70f31c6ac response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53772024-08-22T03:20:50.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ef2a1d06-79b9-4c43-819a-feceba848b71 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53782024-08-22T03:20:50.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ef2a1d06-79b9-4c43-819a-feceba848b71 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53792024-08-22T03:20:50.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ef2a1d06-79b9-4c43-819a-feceba848b71 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53802024-08-22T03:20:51.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7712baf0-7409-4e80-8d85-423233fc611e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53812024-08-22T03:20:51.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7712baf0-7409-4e80-8d85-423233fc611e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53822024-08-22T03:20:51.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7712baf0-7409-4e80-8d85-423233fc611e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53832024-08-22T03:20:52.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3d9167b4-4811-47d2-9c07-6912b435c66e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53842024-08-22T03:20:52.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3d9167b4-4811-47d2-9c07-6912b435c66e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53852024-08-22T03:20:52.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2129 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3d9167b4-4811-47d2-9c07-6912b435c66e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
53862024-08-22T03:20:53.240ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
53872024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
53882024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53892024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
53902024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53912024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
53922024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53932024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53942024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53952024-08-22T03:20:53.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53962024-08-22T03:20:53.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
53982024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53992024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54002024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.571832ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54012024-08-22T03:20:53.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1557, tv_nsec: 760487741 } })
54022024-08-22T03:20:53.243ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1557, tv_nsec: 760496841 } })
54032024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
54042024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
54052024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54062024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
54072024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54082024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54092024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
54102024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54112024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
54122024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54132024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
54142024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
54152024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54162024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54172024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
54182024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54192024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
54202024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54212024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
54222024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54232024-08-22T03:20:53.243ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54242024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54252024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54262024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54272024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54282024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54292024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54302024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54312024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54322024-08-22T03:20:53.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
54332024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54342024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54352024-08-22T03:20:53.244ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
54362024-08-22T03:20:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54372024-08-22T03:20:53.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54382024-08-22T03:20:53.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54392024-08-22T03:20:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54402024-08-22T03:20:53.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54412024-08-22T03:20:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54422024-08-22T03:20:53.246ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54432024-08-22T03:20:53.246ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54442024-08-22T03:20:53.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54452024-08-22T03:20:53.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54462024-08-22T03:20:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54472024-08-22T03:20:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54482024-08-22T03:20:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54492024-08-22T03:20:53.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54502024-08-22T03:20:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54512024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54522024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54532024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54542024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54552024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.900019ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
54562024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54572024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54582024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54592024-08-22T03:20:53.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54602024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54612024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.371945ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54622024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-08-22T03:20:53.248ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
54642024-08-22T03:20:53.248ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54652024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 4.419326ms iteration = 18 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
54662024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54672024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54682024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54692024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54702024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54712024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54722024-08-22T03:20:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54732024-08-22T03:20:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54742024-08-22T03:20:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54752024-08-22T03:20:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54762024-08-22T03:20:53.249ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1557, tv_nsec: 766728499 } })
54772024-08-22T03:20:53.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54782024-08-22T03:20:53.250ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
54792024-08-22T03:20:53.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54802024-08-22T03:20:53.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.659194ms iteration = 18 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
54812024-08-22T03:20:53.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.930347ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
54822024-08-22T03:20:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54832024-08-22T03:20:53.251ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54842024-08-22T03:20:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
54852024-08-22T03:20:53.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54862024-08-22T03:20:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54872024-08-22T03:20:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54882024-08-22T03:20:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54892024-08-22T03:20:53.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54902024-08-22T03:20:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54912024-08-22T03:20:53.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54922024-08-22T03:20:53.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54932024-08-22T03:20:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54942024-08-22T03:20:53.254ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54952024-08-22T03:20:53.254ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 10.520442ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54962024-08-22T03:20:53.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54972024-08-22T03:20:53.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54982024-08-22T03:20:53.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
54992024-08-22T03:20:53.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.306967ms iteration = 52 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
55002024-08-22T03:20:53.259ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.769071ms iteration = 21 status = {"physical_disks_added":0}
55012024-08-22T03:20:53.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55022024-08-22T03:20:53.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55032024-08-22T03:20:53.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55042024-08-22T03:20:53.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55052024-08-22T03:20:53.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55062024-08-22T03:20:53.266ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55072024-08-22T03:20:53.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55082024-08-22T03:20:53.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55092024-08-22T03:20:53.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55102024-08-22T03:20:53.268ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6382e685-3ec7-4037-a3c8-6fe66b597af3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
55112024-08-22T03:20:53.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6382e685-3ec7-4037-a3c8-6fe66b597af3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
55122024-08-22T03:20:53.268ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55132024-08-22T03:20:53.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55142024-08-22T03:20:53.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55152024-08-22T03:20:53.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6382e685-3ec7-4037-a3c8-6fe66b597af3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
55162024-08-22T03:20:53.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55172024-08-22T03:20:53.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55182024-08-22T03:20:53.275ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55192024-08-22T03:20:53.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55202024-08-22T03:20:53.276ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55212024-08-22T03:20:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
55222024-08-22T03:20:53.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55232024-08-22T03:20:53.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55242024-08-22T03:20:53.280ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 36.458368ms iteration = 18 status = 0
55252024-08-22T03:20:53.372ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
55262024-08-22T03:20:53.372ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55272024-08-22T03:20:53.372ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8385da2a-c35a-4331-b5eb-97542bce0bcb", "content-length": "26", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55282024-08-22T03:20:53.372ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55292024-08-22T03:20:53.374ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55302024-08-22T03:20:53.409ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55312024-08-22T03:20:53.409ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eed49c68-c7ee-4efa-90c9-0a4af2e24eec", "content-length": "691", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55322024-08-22T03:20:53.409ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
55332024-08-22T03:20:53.409ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55342024-08-22T03:20:53.409ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55352024-08-22T03:20:53.411ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 167.807109ms iteration = 19 status = {}
55362024-08-22T03:20:53.413ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
55372024-08-22T03:20:53.413ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55382024-08-22T03:20:53.413ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5b0a4a85-a020-4ef5-999c-baedbba0f8e9", "content-length": "26", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55392024-08-22T03:20:53.413ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55402024-08-22T03:20:53.415ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
55412024-08-22T03:20:53.480ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
55422024-08-22T03:20:53.480ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55432024-08-22T03:20:53.480ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fff19ea4-f271-473d-a9cc-c7a136bd7e0e", "content-length": "26", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55442024-08-22T03:20:53.480ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55452024-08-22T03:20:53.482ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55462024-08-22T03:20:53.502ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55472024-08-22T03:20:53.502ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d126af8e-f7ea-494c-a01b-cc7934903a48", "content-length": "372", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55482024-08-22T03:20:53.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55492024-08-22T03:20:53.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55502024-08-22T03:20:53.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55512024-08-22T03:20:53.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55522024-08-22T03:20:53.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55532024-08-22T03:20:53.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55542024-08-22T03:20:53.508ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55552024-08-22T03:20:53.508ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "8153d1a0-e67f-4c15-b87d-c41730668d75", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55562024-08-22T03:20:53.509ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 268.85225ms iteration = 18 status = {}
55572024-08-22T03:20:53.510ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 267.030377ms iteration = 20 status = {}
55582024-08-22T03:20:53.553ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55592024-08-22T03:20:53.554ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ea191fb5-4945-4a78-b7f6-1e1d337f7d93", "content-length": "2", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55602024-08-22T03:20:53.556ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55612024-08-22T03:20:53.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55622024-08-22T03:20:53.557ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 317.001105ms iteration = 18 status = null
55632024-08-22T03:20:53.601ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55642024-08-22T03:20:53.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55652024-08-22T03:20:53.603ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
55662024-08-22T03:20:53.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55672024-08-22T03:20:53.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55682024-08-22T03:20:53.611ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55692024-08-22T03:20:53.611ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b420076c-18fb-4704-b993-3383c595fb84", "content-length": "121", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55702024-08-22T03:20:53.611ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
55712024-08-22T03:20:53.611ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
55722024-08-22T03:20:53.611ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55732024-08-22T03:20:53.611ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55742024-08-22T03:20:53.611ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
55752024-08-22T03:20:53.611ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
55762024-08-22T03:20:53.611ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
55772024-08-22T03:20:53.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55782024-08-22T03:20:53.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55792024-08-22T03:20:53.613ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55802024-08-22T03:20:53.613ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4629b060-6a47-44af-9437-9d1cdc30820d", "content-length": "2", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55812024-08-22T03:20:53.613ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55822024-08-22T03:20:53.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e92410b1-001e-4574-9f7a-0ba82665b4f4", "content-length": "51", "date": "Thu, 22 Aug 2024 03:20:52 GMT"} })
55832024-08-22T03:20:53.614ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
55842024-08-22T03:20:53.614ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55852024-08-22T03:20:53.706ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b40ed016-f53b-4dce-a171-cb0bfe4f7932", "date": "Thu, 22 Aug 2024 03:20:53 GMT"} })
55862024-08-22T03:20:53.706ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
55872024-08-22T03:20:53.706ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55882024-08-22T03:20:53.707ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "13d1703b-f5b0-4e7e-b021-cdab44f0b70c", "content-length": "667", "date": "Thu, 22 Aug 2024 03:20:53 GMT"} })
55892024-08-22T03:20:53.707ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55902024-08-22T03:20:53.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55912024-08-22T03:20:53.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55922024-08-22T03:20:53.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55932024-08-22T03:20:53.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55942024-08-22T03:20:53.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55952024-08-22T03:20:53.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55962024-08-22T03:20:53.721ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55972024-08-22T03:20:53.728ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 485.104959ms iteration = 18 status = {}
55982024-08-22T03:20:54.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4e7cfaa2-c279-4013-85ff-ceac3983900c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
55992024-08-22T03:20:54.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4e7cfaa2-c279-4013-85ff-ceac3983900c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56002024-08-22T03:20:54.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 4e7cfaa2-c279-4013-85ff-ceac3983900c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56012024-08-22T03:20:54.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1473 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 59522d23-a976-422b-9023-bbc915d6750b response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
56022024-08-22T03:20:55.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6399439f-45f4-484f-8e78-60d8fa37d128 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56032024-08-22T03:20:55.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6399439f-45f4-484f-8e78-60d8fa37d128 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56042024-08-22T03:20:55.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6399439f-45f4-484f-8e78-60d8fa37d128 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56052024-08-22T03:20:56.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ae27cb87-f9db-40b7-aa72-ea4b09bd3bcb roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56062024-08-22T03:20:56.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ae27cb87-f9db-40b7-aa72-ea4b09bd3bcb resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56072024-08-22T03:20:56.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ae27cb87-f9db-40b7-aa72-ea4b09bd3bcb response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56082024-08-22T03:20:57.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a2e7144a-5ea0-47e8-80e2-fec074f02b1e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56092024-08-22T03:20:57.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a2e7144a-5ea0-47e8-80e2-fec074f02b1e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56102024-08-22T03:20:57.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a2e7144a-5ea0-47e8-80e2-fec074f02b1e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56112024-08-22T03:20:58.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cd34b925-e0a3-4e87-b9a2-dba0e5551268 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56122024-08-22T03:20:58.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cd34b925-e0a3-4e87-b9a2-dba0e5551268 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56132024-08-22T03:20:58.376ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cd34b925-e0a3-4e87-b9a2-dba0e5551268 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56142024-08-22T03:20:59.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d6a0f8b3-1e9d-4655-90fb-c13f95852dc5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56152024-08-22T03:20:59.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d6a0f8b3-1e9d-4655-90fb-c13f95852dc5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56162024-08-22T03:20:59.398ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d6a0f8b3-1e9d-4655-90fb-c13f95852dc5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56172024-08-22T03:20:59.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 9c849652-8544-47cb-9a36-bea415fb442c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
56182024-08-22T03:20:59.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 9c849652-8544-47cb-9a36-bea415fb442c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
56192024-08-22T03:20:59.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 9c849652-8544-47cb-9a36-bea415fb442c response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
56202024-08-22T03:21:00.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fbf7354f-3226-4c97-b57e-e1eef21b3b74 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56212024-08-22T03:21:00.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fbf7354f-3226-4c97-b57e-e1eef21b3b74 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56222024-08-22T03:21:00.418ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fbf7354f-3226-4c97-b57e-e1eef21b3b74 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56232024-08-22T03:21:01.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e01bd07a-d31a-4bf6-b98a-7487a290ef40 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56242024-08-22T03:21:01.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e01bd07a-d31a-4bf6-b98a-7487a290ef40 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56252024-08-22T03:21:01.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e01bd07a-d31a-4bf6-b98a-7487a290ef40 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56262024-08-22T03:21:02.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 26abfd9a-393f-463d-9020-8e04a725f0ed roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56272024-08-22T03:21:02.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 26abfd9a-393f-463d-9020-8e04a725f0ed resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56282024-08-22T03:21:02.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1765 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 26abfd9a-393f-463d-9020-8e04a725f0ed response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56292024-08-22T03:21:03.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
56302024-08-22T03:21:03.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56312024-08-22T03:21:03.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56322024-08-22T03:21:03.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56332024-08-22T03:21:03.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
56342024-08-22T03:21:03.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56352024-08-22T03:21:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56362024-08-22T03:21:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56372024-08-22T03:21:03.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56382024-08-22T03:21:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56392024-08-22T03:21:03.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56402024-08-22T03:21:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56412024-08-22T03:21:03.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56422024-08-22T03:21:03.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.959938ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56432024-08-22T03:21:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56442024-08-22T03:21:03.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56452024-08-22T03:21:03.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
56462024-08-22T03:21:03.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56472024-08-22T03:21:03.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56482024-08-22T03:21:03.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
56492024-08-22T03:21:03.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.183941ms iteration = 53 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
56502024-08-22T03:21:03.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 57e0c832-ac85-4033-9982-600052fcff01 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56512024-08-22T03:21:03.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 57e0c832-ac85-4033-9982-600052fcff01 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56522024-08-22T03:21:03.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 57e0c832-ac85-4033-9982-600052fcff01 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56532024-08-22T03:21:04.500ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 852a6c4f-36b8-4672-94e9-c02b786d373d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56542024-08-22T03:21:04.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 852a6c4f-36b8-4672-94e9-c02b786d373d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56552024-08-22T03:21:04.502ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 852a6c4f-36b8-4672-94e9-c02b786d373d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56562024-08-22T03:21:04.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1935 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 8d43a185-ec47-47e4-ae85-29caab5ea8a7 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
56572024-08-22T03:21:05.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1332f53f-3676-4442-a94f-1204f11b21bb roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56582024-08-22T03:21:05.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1332f53f-3676-4442-a94f-1204f11b21bb resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56592024-08-22T03:21:05.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1332f53f-3676-4442-a94f-1204f11b21bb response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56602024-08-22T03:21:06.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22e1cac1-844e-40c7-99ed-a66f0bea9202 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56612024-08-22T03:21:06.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22e1cac1-844e-40c7-99ed-a66f0bea9202 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56622024-08-22T03:21:06.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22e1cac1-844e-40c7-99ed-a66f0bea9202 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56632024-08-22T03:21:07.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 13269852-3824-444d-81ee-17c14b97c1d3 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56642024-08-22T03:21:07.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 13269852-3824-444d-81ee-17c14b97c1d3 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56652024-08-22T03:21:07.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 13269852-3824-444d-81ee-17c14b97c1d3 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56662024-08-22T03:21:08.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e986f224-aa40-4539-9cb7-d4e1b85bd066 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56672024-08-22T03:21:08.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e986f224-aa40-4539-9cb7-d4e1b85bd066 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56682024-08-22T03:21:08.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e986f224-aa40-4539-9cb7-d4e1b85bd066 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56692024-08-22T03:21:09.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7edbdf78-130e-41d7-a2c0-55a065edd6a5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56702024-08-22T03:21:09.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7edbdf78-130e-41d7-a2c0-55a065edd6a5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56712024-08-22T03:21:09.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7edbdf78-130e-41d7-a2c0-55a065edd6a5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56722024-08-22T03:21:10.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 082609db-4cbb-4e7e-ae0e-5f8719ba07dd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56732024-08-22T03:21:10.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 082609db-4cbb-4e7e-ae0e-5f8719ba07dd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56742024-08-22T03:21:10.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 082609db-4cbb-4e7e-ae0e-5f8719ba07dd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56752024-08-22T03:21:11.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2f4aaa64-5820-48d2-b860-fbdca2f71ef7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56762024-08-22T03:21:11.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2f4aaa64-5820-48d2-b860-fbdca2f71ef7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56772024-08-22T03:21:11.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2542 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2f4aaa64-5820-48d2-b860-fbdca2f71ef7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56782024-08-22T03:21:12.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0469e6f7-5e9e-4930-b55f-36b0a1eaaa31 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56792024-08-22T03:21:12.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0469e6f7-5e9e-4930-b55f-36b0a1eaaa31 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56802024-08-22T03:21:12.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1727 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0469e6f7-5e9e-4930-b55f-36b0a1eaaa31 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
56812024-08-22T03:21:13.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
56822024-08-22T03:21:13.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56832024-08-22T03:21:13.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56842024-08-22T03:21:13.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56852024-08-22T03:21:13.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
56862024-08-22T03:21:13.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56872024-08-22T03:21:13.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56882024-08-22T03:21:13.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56892024-08-22T03:21:13.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56902024-08-22T03:21:13.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56912024-08-22T03:21:13.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56922024-08-22T03:21:13.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56932024-08-22T03:21:13.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56942024-08-22T03:21:13.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56952024-08-22T03:21:13.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.13269ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56962024-08-22T03:21:13.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56972024-08-22T03:21:13.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
56982024-08-22T03:21:13.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56992024-08-22T03:21:13.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57002024-08-22T03:21:13.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
57012024-08-22T03:21:13.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.849179ms iteration = 54 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
57022024-08-22T03:21:13.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c5c6891-2e72-4e76-932d-7efc156b2324 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57032024-08-22T03:21:13.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c5c6891-2e72-4e76-932d-7efc156b2324 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57042024-08-22T03:21:13.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3c5c6891-2e72-4e76-932d-7efc156b2324 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57052024-08-22T03:21:14.599ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1479 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = cfd54113-982f-4b2e-90a6-564f0671ac78 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
57062024-08-22T03:21:14.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d9cb0548-d8c4-44ed-a3b9-6338c159bd47 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57072024-08-22T03:21:14.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d9cb0548-d8c4-44ed-a3b9-6338c159bd47 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57082024-08-22T03:21:14.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d9cb0548-d8c4-44ed-a3b9-6338c159bd47 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57092024-08-22T03:21:15.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73d94a5e-0d32-4c7d-aebc-93aaf628ebda roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57102024-08-22T03:21:15.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73d94a5e-0d32-4c7d-aebc-93aaf628ebda resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57112024-08-22T03:21:15.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 73d94a5e-0d32-4c7d-aebc-93aaf628ebda response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57122024-08-22T03:21:16.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c1567a27-7ca7-4ab8-85c9-4f395dd0d054 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57132024-08-22T03:21:16.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c1567a27-7ca7-4ab8-85c9-4f395dd0d054 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57142024-08-22T03:21:16.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c1567a27-7ca7-4ab8-85c9-4f395dd0d054 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57152024-08-22T03:21:17.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = deadc236-e3ae-4d84-85cb-8ef0b43e0398 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57162024-08-22T03:21:17.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = deadc236-e3ae-4d84-85cb-8ef0b43e0398 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57172024-08-22T03:21:17.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = deadc236-e3ae-4d84-85cb-8ef0b43e0398 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57182024-08-22T03:21:18.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 912985fe-1081-42d9-9b1f-b3ddd38e6cfd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57192024-08-22T03:21:18.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 912985fe-1081-42d9-9b1f-b3ddd38e6cfd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57202024-08-22T03:21:18.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 912985fe-1081-42d9-9b1f-b3ddd38e6cfd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57212024-08-22T03:21:19.821ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 24d9d4b0-aaa8-4604-bee1-41419fd4fcc4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57222024-08-22T03:21:19.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 24d9d4b0-aaa8-4604-bee1-41419fd4fcc4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57232024-08-22T03:21:19.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 24d9d4b0-aaa8-4604-bee1-41419fd4fcc4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57242024-08-22T03:21:20.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e20a47d-7051-477e-8549-a0e881b5f21f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57252024-08-22T03:21:20.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e20a47d-7051-477e-8549-a0e881b5f21f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57262024-08-22T03:21:20.843ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1e20a47d-7051-477e-8549-a0e881b5f21f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57272024-08-22T03:21:21.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = debac9d1-7352-4e7c-bd0b-2b01eb6a5a89 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57282024-08-22T03:21:21.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = debac9d1-7352-4e7c-bd0b-2b01eb6a5a89 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57292024-08-22T03:21:21.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = debac9d1-7352-4e7c-bd0b-2b01eb6a5a89 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57302024-08-22T03:21:22.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 94547b20-f706-43a1-899f-54a6224e9927 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57312024-08-22T03:21:22.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 94547b20-f706-43a1-899f-54a6224e9927 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57322024-08-22T03:21:22.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1843 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 94547b20-f706-43a1-899f-54a6224e9927 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
57332024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
57342024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
57352024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
57362024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
57372024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
57382024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57392024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
57402024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57412024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
57422024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57432024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57442024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
57452024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
57462024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
57472024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57482024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57492024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57502024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
57512024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57522024-08-22T03:21:23.241ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = bff907f0-2101-418e-8f5d-955661c8bd6f
57532024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
57542024-08-22T03:21:23.241ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.16\u{b5}s iteration = 11 status = {"error":"blueprint disabled","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f"}
57552024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
57562024-08-22T03:21:23.242ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-22 03:11:23.241867749 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57572024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57582024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57592024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57602024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57612024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57622024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57632024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57642024-08-22T03:21:23.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57652024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
57662024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57672024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
57682024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57692024-08-22T03:21:23.243ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3ce7517f-82f9-4849-ad08-7cb0bf67f024.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 759825560 } })
57702024-08-22T03:21:23.243ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1467044e-2fe8-4015-be86-a3faa36f1469.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64fff417-46fd-44ed-ac7e-a3829d9efa54.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 759844140 } })
57712024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57722024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57732024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57742024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57752024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57762024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57772024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57782024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57792024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57802024-08-22T03:21:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57812024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57822024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57832024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57842024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57852024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
57862024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
57872024-08-22T03:21:23.244ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57882024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57892024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57902024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
57912024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57922024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
57932024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57942024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
57952024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57962024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
57972024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57982024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
57992024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58002024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
58012024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58022024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
58032024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
58042024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
58052024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
58062024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
58072024-08-22T03:21:23.244ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
58082024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
58092024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
58102024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58112024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
58122024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
58132024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58142024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58152024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58162024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58172024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58182024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58192024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58202024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58212024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58222024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
58232024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58242024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58252024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58262024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58272024-08-22T03:21:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58282024-08-22T03:21:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58292024-08-22T03:21:23.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58302024-08-22T03:21:23.245ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
58312024-08-22T03:21:23.245ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.360982ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
58322024-08-22T03:21:23.245ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.944519ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58332024-08-22T03:21:23.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58342024-08-22T03:21:23.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
58352024-08-22T03:21:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 4.363705ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
58362024-08-22T03:21:23.246ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 762637315 } })
58372024-08-22T03:21:23.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58382024-08-22T03:21:23.246ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58392024-08-22T03:21:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58402024-08-22T03:21:23.247ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
58412024-08-22T03:21:23.247ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
58422024-08-22T03:21:23.247ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58432024-08-22T03:21:23.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58442024-08-22T03:21:23.247ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-22 03:11:23.241867749 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58452024-08-22T03:21:23.247ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.56575ms iteration = 10 status = {"expiration":"2024-08-22T03:11:23.241867749Z","pruned":[]}
58462024-08-22T03:21:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58472024-08-22T03:21:23.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58482024-08-22T03:21:23.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58492024-08-22T03:21:23.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58502024-08-22T03:21:23.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58512024-08-22T03:21:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58522024-08-22T03:21:23.248ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532024-08-22T03:21:23.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 764634040 } })
58542024-08-22T03:21:23.248ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58552024-08-22T03:21:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58562024-08-22T03:21:23.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
58572024-08-22T03:21:23.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582024-08-22T03:21:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58592024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
58602024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
58612024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
58622024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58632024-08-22T03:21:23.249ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
58642024-08-22T03:21:23.249ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58652024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.043074ms iteration = 19 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
58662024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58672024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58682024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58692024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58702024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58712024-08-22T03:21:23.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58722024-08-22T03:21:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58732024-08-22T03:21:23.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58742024-08-22T03:21:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58752024-08-22T03:21:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.248899ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
58762024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58772024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58782024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58792024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
58802024-08-22T03:21:23.251ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
58812024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58822024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58832024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.784875ms iteration = 10 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
58842024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58852024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58862024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58872024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58882024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58892024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58902024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58912024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58922024-08-22T03:21:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58932024-08-22T03:21:23.252ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58942024-08-22T03:21:23.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58952024-08-22T03:21:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58962024-08-22T03:21:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58972024-08-22T03:21:23.253ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.73359ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
58982024-08-22T03:21:23.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58992024-08-22T03:21:23.253ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.421479ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59002024-08-22T03:21:23.253ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012024-08-22T03:21:23.253ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59022024-08-22T03:21:23.253ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59032024-08-22T03:21:23.253ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59042024-08-22T03:21:23.253ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59052024-08-22T03:21:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59062024-08-22T03:21:23.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59072024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59082024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59092024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59102024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59112024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59122024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59132024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59142024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59152024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
59162024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59172024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59182024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59192024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59202024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59212024-08-22T03:21:23.255ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59222024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 11.345443ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59232024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59242024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59252024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59262024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59272024-08-22T03:21:23.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59282024-08-22T03:21:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59292024-08-22T03:21:23.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59302024-08-22T03:21:23.257ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59312024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 12.821521ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59322024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59332024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
59342024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 0 version = 2
59352024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59362024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59372024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
59382024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59392024-08-22T03:21:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59402024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59412024-08-22T03:21:23.258ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 774727637 } })
59422024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59432024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59442024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59452024-08-22T03:21:23.258ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
59462024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59472024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59482024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59492024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59502024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
59512024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59522024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59532024-08-22T03:21:23.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59542024-08-22T03:21:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59552024-08-22T03:21:23.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59562024-08-22T03:21:23.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59572024-08-22T03:21:23.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 14.900157ms iteration = 19 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
59582024-08-22T03:21:23.260ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59592024-08-22T03:21:23.260ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59602024-08-22T03:21:23.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59612024-08-22T03:21:23.260ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59622024-08-22T03:21:23.260ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59632024-08-22T03:21:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59642024-08-22T03:21:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59652024-08-22T03:21:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59662024-08-22T03:21:23.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59672024-08-22T03:21:23.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59682024-08-22T03:21:23.261ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59692024-08-22T03:21:23.261ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59702024-08-22T03:21:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59712024-08-22T03:21:23.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59722024-08-22T03:21:23.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59732024-08-22T03:21:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59742024-08-22T03:21:23.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59752024-08-22T03:21:23.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 18.31964ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59762024-08-22T03:21:23.263ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 1 version = 2
59772024-08-22T03:21:23.263ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
59782024-08-22T03:21:23.263ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-22 03:13:03.125979 UTC dns_group = external generation = 2
59792024-08-22T03:21:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 21.749663ms iteration = 11 status = {"generation":2}
59802024-08-22T03:21:23.263ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 20.66783ms iteration = 22 status = {"physical_disks_added":0}
59812024-08-22T03:21:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59822024-08-22T03:21:23.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59832024-08-22T03:21:23.264ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59842024-08-22T03:21:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59852024-08-22T03:21:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59862024-08-22T03:21:23.264ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59872024-08-22T03:21:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59882024-08-22T03:21:23.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59892024-08-22T03:21:23.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59902024-08-22T03:21:23.265ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
59912024-08-22T03:21:23.265ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.989072ms iteration = 55 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
59922024-08-22T03:21:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59932024-08-22T03:21:23.266ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59942024-08-22T03:21:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59952024-08-22T03:21:23.266ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
59962024-08-22T03:21:23.266ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
59972024-08-22T03:21:23.266ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-22 03:13:02.692706 UTC dns_group = internal generation = 1
59982024-08-22T03:21:23.266ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 24.899043ms iteration = 11 status = {"generation":1}
59992024-08-22T03:21:23.267ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 24.409317ms iteration = 5 status = {"nsuccess":5}
60002024-08-22T03:21:23.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60012024-08-22T03:21:23.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60022024-08-22T03:21:23.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60032024-08-22T03:21:23.271ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-22T03:12:22.052278Z, time_modified: 2024-08-22T03:12:22.052278Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }) }
60042024-08-22T03:21:23.271ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 29.362299ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]}},"default_endpoint":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60052024-08-22T03:21:23.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60062024-08-22T03:21:23.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60072024-08-22T03:21:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60082024-08-22T03:21:23.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60092024-08-22T03:21:23.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60102024-08-22T03:21:23.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60112024-08-22T03:21:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60122024-08-22T03:21:23.278ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60132024-08-22T03:21:23.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60142024-08-22T03:21:23.280ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60152024-08-22T03:21:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60162024-08-22T03:21:23.281ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60172024-08-22T03:21:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
60182024-08-22T03:21:23.283ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60192024-08-22T03:21:23.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60202024-08-22T03:21:23.284ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 40.273087ms iteration = 19 status = 0
60212024-08-22T03:21:23.471ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
60222024-08-22T03:21:23.471ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60232024-08-22T03:21:23.471ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "43e0b8bf-8690-4ab8-b422-19f335cdc923", "content-length": "26", "date": "Thu, 22 Aug 2024 03:21:22 GMT"} })
60242024-08-22T03:21:23.471ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60252024-08-22T03:21:23.473ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
60262024-08-22T03:21:23.557ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60272024-08-22T03:21:23.601ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
60282024-08-22T03:21:23.638ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
60292024-08-22T03:21:23.638ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60302024-08-22T03:21:23.639ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "540f1aeb-60d5-46fc-98bb-ab2be6974b06", "content-length": "26", "date": "Thu, 22 Aug 2024 03:21:22 GMT"} })
60312024-08-22T03:21:23.639ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60322024-08-22T03:21:23.640ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60332024-08-22T03:21:23.645ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60342024-08-22T03:21:23.645ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
60352024-08-22T03:21:23.645ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60362024-08-22T03:21:23.645ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "931bcd7b-a73a-4663-bf0c-c25caacd72ca", "content-length": "26", "date": "Thu, 22 Aug 2024 03:21:22 GMT"} })
60372024-08-22T03:21:23.645ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60382024-08-22T03:21:23.645ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e0d260b6-6997-4072-97a5-b6e306724e05", "content-length": "691", "date": "Thu, 22 Aug 2024 03:21:22 GMT"} })
60392024-08-22T03:21:23.645ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
60402024-08-22T03:21:23.645ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
60412024-08-22T03:21:23.645ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
60422024-08-22T03:21:23.647ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
60432024-08-22T03:21:23.647ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 403.28607ms iteration = 20 status = {}
60442024-08-22T03:21:23.663ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60452024-08-22T03:21:23.663ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "79266b45-2307-426e-923c-0f013adfac08", "content-length": "372", "date": "Thu, 22 Aug 2024 03:21:22 GMT"} })
60462024-08-22T03:21:23.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60472024-08-22T03:21:23.663ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60482024-08-22T03:21:23.665ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60492024-08-22T03:21:23.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60502024-08-22T03:21:23.668ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60512024-08-22T03:21:23.668ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60522024-08-22T03:21:23.670ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60532024-08-22T03:21:23.670ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "a3240bde-070d-4fb5-8b4f-4ca80d95fc1a", "date": "Thu, 22 Aug 2024 03:21:22 GMT"} })
60542024-08-22T03:21:23.672ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 427.731048ms iteration = 21 status = {}
60552024-08-22T03:21:23.754ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
60562024-08-22T03:21:23.767ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60572024-08-22T03:21:23.768ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "ad86a44d-a6bd-495f-8adb-7440bc7bc34f", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60582024-08-22T03:21:23.768ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60592024-08-22T03:21:23.770ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4e444772-4606-47b4-87eb-6b659177fd78", "date": "Thu, 22 Aug 2024 03:21:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60602024-08-22T03:21:23.770ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60612024-08-22T03:21:23.772ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60622024-08-22T03:21:23.772ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 530.874884ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60632024-08-22T03:21:23.783ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60642024-08-22T03:21:23.784ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4cd5d3ea-3a45-4321-a970-4632b25fae56", "content-length": "2", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} })
60652024-08-22T03:21:23.785ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 543.982839ms iteration = 19 status = {}
60662024-08-22T03:21:23.786ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60672024-08-22T03:21:23.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60682024-08-22T03:21:23.788ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 546.613412ms iteration = 19 status = null
60692024-08-22T03:21:23.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60702024-08-22T03:21:23.809ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "1f74a526-62e3-4426-9e18-b505159f6e05", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60712024-08-22T03:21:23.809ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60722024-08-22T03:21:23.811ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9b917842-e249-403f-90be-360fad019b40", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60732024-08-22T03:21:23.811ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60742024-08-22T03:21:23.813ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "347f665b-a4e9-4e7d-bc61-e782e7994403", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60752024-08-22T03:21:23.813ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60762024-08-22T03:21:23.815ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
60772024-08-22T03:21:23.815ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 573.781084ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60782024-08-22T03:21:23.827ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60792024-08-22T03:21:23.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60802024-08-22T03:21:23.829ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
60812024-08-22T03:21:23.829ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60822024-08-22T03:21:23.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60832024-08-22T03:21:23.837ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60842024-08-22T03:21:23.837ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b816a839-b2c7-4aba-9b3a-78c4ab9469a9", "content-length": "121", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} })
60852024-08-22T03:21:23.837ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
60862024-08-22T03:21:23.837ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
60872024-08-22T03:21:23.838ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60882024-08-22T03:21:23.838ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60892024-08-22T03:21:23.838ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
60902024-08-22T03:21:23.838ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
60912024-08-22T03:21:23.838ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
60922024-08-22T03:21:23.838ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60932024-08-22T03:21:23.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60942024-08-22T03:21:23.839ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
60952024-08-22T03:21:23.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "24f1e118-9020-4a55-845e-e6c60c2af166", "content-length": "2", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} })
60962024-08-22T03:21:23.840ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
60972024-08-22T03:21:23.840ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "bbbaad42-7f66-4e1d-932e-30eba7b57947", "content-length": "51", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} })
60982024-08-22T03:21:23.840ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
60992024-08-22T03:21:23.840ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61002024-08-22T03:21:23.934ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "e03970a2-df38-4a60-81a6-dd61fbaa7a90", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} })
61012024-08-22T03:21:23.934ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
61022024-08-22T03:21:23.934ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61032024-08-22T03:21:23.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b7fc78a6-3f77-4892-8c54-2ca40f4beb68 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61042024-08-22T03:21:23.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b7fc78a6-3f77-4892-8c54-2ca40f4beb68 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61052024-08-22T03:21:23.935ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9d45c558-a037-4feb-b216-c7716da69c91", "content-length": "667", "date": "Thu, 22 Aug 2024 03:21:23 GMT"} })
61062024-08-22T03:21:23.935ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61072024-08-22T03:21:23.935ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61082024-08-22T03:21:23.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b7fc78a6-3f77-4892-8c54-2ca40f4beb68 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61092024-08-22T03:21:23.938ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61102024-08-22T03:21:23.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61112024-08-22T03:21:23.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61122024-08-22T03:21:23.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61132024-08-22T03:21:23.942ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61142024-08-22T03:21:23.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61152024-08-22T03:21:23.950ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 705.711091ms iteration = 19 status = {}
61162024-08-22T03:21:24.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1692 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 0087e2fd-4365-410f-98af-9c653c4826d4 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
61172024-08-22T03:21:24.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9d99ddb4-42c2-4e80-80fa-b735c93b6236 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61182024-08-22T03:21:24.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9d99ddb4-42c2-4e80-80fa-b735c93b6236 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61192024-08-22T03:21:24.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 9d99ddb4-42c2-4e80-80fa-b735c93b6236 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61202024-08-22T03:21:25.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e2137192-733a-4650-ac99-6bf57f04989f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61212024-08-22T03:21:25.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e2137192-733a-4650-ac99-6bf57f04989f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61222024-08-22T03:21:25.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e2137192-733a-4650-ac99-6bf57f04989f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61232024-08-22T03:21:26.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7230a7e1-7652-4a9d-ad98-72afbb393b38 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61242024-08-22T03:21:26.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7230a7e1-7652-4a9d-ad98-72afbb393b38 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61252024-08-22T03:21:27.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7230a7e1-7652-4a9d-ad98-72afbb393b38 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61262024-08-22T03:21:28.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a91f59df-7698-4815-a307-28b079d4d883 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61272024-08-22T03:21:28.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a91f59df-7698-4815-a307-28b079d4d883 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61282024-08-22T03:21:28.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1863 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a91f59df-7698-4815-a307-28b079d4d883 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61292024-08-22T03:21:29.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b6f5c2a3-722e-4f96-95a5-632afb09de1e roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61302024-08-22T03:21:29.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b6f5c2a3-722e-4f96-95a5-632afb09de1e resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61312024-08-22T03:21:29.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b6f5c2a3-722e-4f96-95a5-632afb09de1e response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61322024-08-22T03:21:30.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = f2928634-935f-4493-9f9d-143a1689283c roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
61332024-08-22T03:21:30.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = f2928634-935f-4493-9f9d-143a1689283c resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
61342024-08-22T03:21:30.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = f2928634-935f-4493-9f9d-143a1689283c response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
61352024-08-22T03:21:30.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e330096-fd47-419e-8429-351bed849bfb roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61362024-08-22T03:21:30.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e330096-fd47-419e-8429-351bed849bfb resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61372024-08-22T03:21:30.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0e330096-fd47-419e-8429-351bed849bfb response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61382024-08-22T03:21:31.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 55df7e5c-656a-412f-98b2-8939733f3ea9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61392024-08-22T03:21:31.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 55df7e5c-656a-412f-98b2-8939733f3ea9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61402024-08-22T03:21:31.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 55df7e5c-656a-412f-98b2-8939733f3ea9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61412024-08-22T03:21:32.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 37811543-d18a-4e32-a900-783f8b31ed5d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61422024-08-22T03:21:32.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 37811543-d18a-4e32-a900-783f8b31ed5d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61432024-08-22T03:21:32.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 37811543-d18a-4e32-a900-783f8b31ed5d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61442024-08-22T03:21:33.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d178d278-bf5a-4a2b-a544-412ff013b8e0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61452024-08-22T03:21:33.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d178d278-bf5a-4a2b-a544-412ff013b8e0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61462024-08-22T03:21:33.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d178d278-bf5a-4a2b-a544-412ff013b8e0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61472024-08-22T03:21:33.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
61482024-08-22T03:21:33.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61492024-08-22T03:21:33.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61502024-08-22T03:21:33.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61512024-08-22T03:21:33.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
61522024-08-22T03:21:33.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61532024-08-22T03:21:33.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61542024-08-22T03:21:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61552024-08-22T03:21:33.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61562024-08-22T03:21:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61572024-08-22T03:21:33.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61582024-08-22T03:21:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61592024-08-22T03:21:33.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61602024-08-22T03:21:33.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.015247ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61612024-08-22T03:21:33.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61622024-08-22T03:21:33.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632024-08-22T03:21:33.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
61642024-08-22T03:21:33.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61652024-08-22T03:21:33.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61662024-08-22T03:21:33.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
61672024-08-22T03:21:33.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.645094ms iteration = 56 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
61682024-08-22T03:21:34.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fb198ef7-c935-471c-842d-45c100d10c5c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61692024-08-22T03:21:34.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fb198ef7-c935-471c-842d-45c100d10c5c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61702024-08-22T03:21:34.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fb198ef7-c935-471c-842d-45c100d10c5c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61712024-08-22T03:21:34.601ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 1c1744e7-7ba1-4fdf-83b6-155ae123a937 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
61722024-08-22T03:21:35.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c98ede21-269a-49fd-9275-2717f3a3ebbd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61732024-08-22T03:21:35.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c98ede21-269a-49fd-9275-2717f3a3ebbd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61742024-08-22T03:21:35.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c98ede21-269a-49fd-9275-2717f3a3ebbd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61752024-08-22T03:21:36.191ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a03a40ed-95ea-4096-a339-76b376a99ffe roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61762024-08-22T03:21:36.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a03a40ed-95ea-4096-a339-76b376a99ffe resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61772024-08-22T03:21:36.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a03a40ed-95ea-4096-a339-76b376a99ffe response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61782024-08-22T03:21:37.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0a6abede-557c-4be9-8779-6cd18540d3a4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61792024-08-22T03:21:37.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0a6abede-557c-4be9-8779-6cd18540d3a4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61802024-08-22T03:21:37.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0a6abede-557c-4be9-8779-6cd18540d3a4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61812024-08-22T03:21:38.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 27cfc9ff-8b7a-4b02-aa67-0469adec19aa roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61822024-08-22T03:21:38.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 27cfc9ff-8b7a-4b02-aa67-0469adec19aa resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61832024-08-22T03:21:38.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2395 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 27cfc9ff-8b7a-4b02-aa67-0469adec19aa response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61842024-08-22T03:21:39.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dc6cc307-6905-4a8a-9835-d362d06b6c4c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61852024-08-22T03:21:39.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dc6cc307-6905-4a8a-9835-d362d06b6c4c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61862024-08-22T03:21:39.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = dc6cc307-6905-4a8a-9835-d362d06b6c4c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61872024-08-22T03:21:40.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a3dee108-4b39-4c3e-9eda-144373065081 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61882024-08-22T03:21:40.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a3dee108-4b39-4c3e-9eda-144373065081 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61892024-08-22T03:21:40.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a3dee108-4b39-4c3e-9eda-144373065081 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61902024-08-22T03:21:41.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a14a24bc-85bc-40b3-bf25-a0368c9b2b01 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61912024-08-22T03:21:41.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a14a24bc-85bc-40b3-bf25-a0368c9b2b01 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61922024-08-22T03:21:41.298ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1940 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a14a24bc-85bc-40b3-bf25-a0368c9b2b01 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61932024-08-22T03:21:42.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1b87f082-0a9e-43af-a2a8-9e13cc9b3dc5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61942024-08-22T03:21:42.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1b87f082-0a9e-43af-a2a8-9e13cc9b3dc5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61952024-08-22T03:21:42.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1b87f082-0a9e-43af-a2a8-9e13cc9b3dc5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
61962024-08-22T03:21:43.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
61972024-08-22T03:21:43.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61982024-08-22T03:21:43.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61992024-08-22T03:21:43.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62002024-08-22T03:21:43.244ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
62012024-08-22T03:21:43.244ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62022024-08-22T03:21:43.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62032024-08-22T03:21:43.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62042024-08-22T03:21:43.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62052024-08-22T03:21:43.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62062024-08-22T03:21:43.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62072024-08-22T03:21:43.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62082024-08-22T03:21:43.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62092024-08-22T03:21:43.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62102024-08-22T03:21:43.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.119649ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62112024-08-22T03:21:43.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62122024-08-22T03:21:43.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
62132024-08-22T03:21:43.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62142024-08-22T03:21:43.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62152024-08-22T03:21:43.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
62162024-08-22T03:21:43.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.070202ms iteration = 57 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
62172024-08-22T03:21:43.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 490ee877-e814-43b0-9829-a0578e064bdb roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62182024-08-22T03:21:43.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 490ee877-e814-43b0-9829-a0578e064bdb resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62192024-08-22T03:21:43.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 490ee877-e814-43b0-9829-a0578e064bdb response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62202024-08-22T03:21:44.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ac9dad4-8058-4c50-bed0-ca7748d7fd6b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62212024-08-22T03:21:44.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ac9dad4-8058-4c50-bed0-ca7748d7fd6b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62222024-08-22T03:21:44.361ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7ac9dad4-8058-4c50-bed0-ca7748d7fd6b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62232024-08-22T03:21:44.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1584 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = d85e4628-1dcc-496b-b0f6-ea0aeaae8ff2 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
62242024-08-22T03:21:45.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 59000ea4-cd07-4155-88c5-ddf07cd286ff roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62252024-08-22T03:21:45.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 59000ea4-cd07-4155-88c5-ddf07cd286ff resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62262024-08-22T03:21:45.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 59000ea4-cd07-4155-88c5-ddf07cd286ff response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62272024-08-22T03:21:46.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 772261c5-f94e-4b8f-8da2-389198efdcda roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62282024-08-22T03:21:46.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 772261c5-f94e-4b8f-8da2-389198efdcda resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62292024-08-22T03:21:46.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 772261c5-f94e-4b8f-8da2-389198efdcda response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62302024-08-22T03:21:47.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d89f778a-0b3e-4f3c-b30a-087d713115d2 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62312024-08-22T03:21:47.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d89f778a-0b3e-4f3c-b30a-087d713115d2 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62322024-08-22T03:21:47.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d89f778a-0b3e-4f3c-b30a-087d713115d2 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62332024-08-22T03:21:48.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 63dc2fe2-674e-4c8b-a2cc-c4c9c8caca74 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62342024-08-22T03:21:48.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 63dc2fe2-674e-4c8b-a2cc-c4c9c8caca74 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62352024-08-22T03:21:48.448ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 63dc2fe2-674e-4c8b-a2cc-c4c9c8caca74 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62362024-08-22T03:21:49.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1104dee3-2bfe-4b0d-974e-339cdd3c672d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62372024-08-22T03:21:49.468ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1104dee3-2bfe-4b0d-974e-339cdd3c672d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62382024-08-22T03:21:49.470ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1104dee3-2bfe-4b0d-974e-339cdd3c672d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62392024-08-22T03:21:50.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8be93cfd-eaa8-4a77-984e-a55ec2212d24 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62402024-08-22T03:21:50.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8be93cfd-eaa8-4a77-984e-a55ec2212d24 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62412024-08-22T03:21:50.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 8be93cfd-eaa8-4a77-984e-a55ec2212d24 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62422024-08-22T03:21:51.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a485ae38-ed0f-47fe-b0bd-4e63919cd233 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62432024-08-22T03:21:51.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a485ae38-ed0f-47fe-b0bd-4e63919cd233 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62442024-08-22T03:21:51.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = a485ae38-ed0f-47fe-b0bd-4e63919cd233 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62452024-08-22T03:21:52.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 198a833d-0aaa-4440-b5c4-c95e1579d079 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62462024-08-22T03:21:52.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 198a833d-0aaa-4440-b5c4-c95e1579d079 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62472024-08-22T03:21:52.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 198a833d-0aaa-4440-b5c4-c95e1579d079 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
62482024-08-22T03:21:53.241ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
62492024-08-22T03:21:53.241ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
62502024-08-22T03:21:53.241ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62512024-08-22T03:21:53.241ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
62522024-08-22T03:21:53.241ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
62532024-08-22T03:21:53.241ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
62542024-08-22T03:21:53.242ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62552024-08-22T03:21:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62562024-08-22T03:21:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62572024-08-22T03:21:53.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62582024-08-22T03:21:53.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62592024-08-22T03:21:53.243ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
62602024-08-22T03:21:53.243ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62612024-08-22T03:21:53.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62622024-08-22T03:21:53.244ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1617, tv_nsec: 760515377 } })
62632024-08-22T03:21:53.244ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.075709ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62642024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62652024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
62662024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62672024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
62682024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
62692024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62702024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62712024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
62722024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62732024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
62742024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
62752024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62762024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62772024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
62782024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62792024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
62802024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
62812024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62822024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
62832024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
62842024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62852024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62862024-08-22T03:21:53.245ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
62872024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62882024-08-22T03:21:53.245ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1617, tv_nsec: 761732802 } })
62892024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62902024-08-22T03:21:53.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62912024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62922024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62932024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62942024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62952024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62962024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62972024-08-22T03:21:53.246ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
62982024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62992024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63002024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63012024-08-22T03:21:53.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63022024-08-22T03:21:53.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63032024-08-22T03:21:53.247ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63042024-08-22T03:21:53.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63052024-08-22T03:21:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63062024-08-22T03:21:53.247ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63072024-08-22T03:21:53.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63082024-08-22T03:21:53.247ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.471391ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
63092024-08-22T03:21:53.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63102024-08-22T03:21:53.248ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63112024-08-22T03:21:53.248ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63122024-08-22T03:21:53.249ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
63132024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63142024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63152024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63162024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63172024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.677276ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63182024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63192024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63202024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
63212024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
63222024-08-22T03:21:53.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
63232024-08-22T03:21:53.250ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63242024-08-22T03:21:53.250ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63252024-08-22T03:21:53.250ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
63262024-08-22T03:21:53.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63272024-08-22T03:21:53.250ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
63282024-08-22T03:21:53.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
63292024-08-22T03:21:53.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
63302024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63312024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63322024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
63332024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63342024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63352024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63362024-08-22T03:21:53.251ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
63372024-08-22T03:21:53.251ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63382024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 5.982295ms iteration = 20 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
63392024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 6.026285ms iteration = 20 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
63402024-08-22T03:21:53.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.238168ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63412024-08-22T03:21:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
63422024-08-22T03:21:53.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63432024-08-22T03:21:53.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63442024-08-22T03:21:53.252ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63452024-08-22T03:21:53.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63462024-08-22T03:21:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63472024-08-22T03:21:53.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63482024-08-22T03:21:53.253ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1617, tv_nsec: 769107765 } })
63492024-08-22T03:21:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63502024-08-22T03:21:53.253ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63512024-08-22T03:21:53.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63522024-08-22T03:21:53.253ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
63532024-08-22T03:21:53.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63542024-08-22T03:21:53.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63552024-08-22T03:21:53.255ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63562024-08-22T03:21:53.255ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 9.52376ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63572024-08-22T03:21:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
63582024-08-22T03:21:53.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63592024-08-22T03:21:53.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63602024-08-22T03:21:53.260ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63612024-08-22T03:21:53.261ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 17.191956ms iteration = 23 status = {"physical_disks_added":0}
63622024-08-22T03:21:53.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63632024-08-22T03:21:53.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
63642024-08-22T03:21:53.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.487478ms iteration = 58 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
63652024-08-22T03:21:53.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63662024-08-22T03:21:53.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63672024-08-22T03:21:53.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63682024-08-22T03:21:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63692024-08-22T03:21:53.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63702024-08-22T03:21:53.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63712024-08-22T03:21:53.268ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63722024-08-22T03:21:53.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63732024-08-22T03:21:53.270ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63742024-08-22T03:21:53.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63752024-08-22T03:21:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
63762024-08-22T03:21:53.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63772024-08-22T03:21:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63782024-08-22T03:21:53.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63792024-08-22T03:21:53.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63802024-08-22T03:21:53.272ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 26.647475ms iteration = 20 status = 0
63812024-08-22T03:21:53.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63822024-08-22T03:21:53.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63832024-08-22T03:21:53.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63842024-08-22T03:21:53.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
63852024-08-22T03:21:53.393ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63862024-08-22T03:21:53.394ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "90e76c6a-d87b-4afa-b763-741a0927e721", "content-length": "26", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
63872024-08-22T03:21:53.394ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63882024-08-22T03:21:53.396ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63892024-08-22T03:21:53.399ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63902024-08-22T03:21:53.400ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e548ff92-98ee-4104-9365-198d036d3c43", "content-length": "372", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
63912024-08-22T03:21:53.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63922024-08-22T03:21:53.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63932024-08-22T03:21:53.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63942024-08-22T03:21:53.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63952024-08-22T03:21:53.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63962024-08-22T03:21:53.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63972024-08-22T03:21:53.406ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63982024-08-22T03:21:53.406ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "9d0e58bb-ac7a-43f4-a9cf-d2ba793d7751", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
63992024-08-22T03:21:53.408ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 163.398254ms iteration = 22 status = {}
64002024-08-22T03:21:53.427ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
64012024-08-22T03:21:53.427ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b5f38746-daa8-47f4-991e-af20b1c4807e", "content-length": "691", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
64022024-08-22T03:21:53.427ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
64032024-08-22T03:21:53.427ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
64042024-08-22T03:21:53.427ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
64052024-08-22T03:21:53.429ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 183.72128ms iteration = 21 status = {}
64062024-08-22T03:21:53.475ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
64072024-08-22T03:21:53.475ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64082024-08-22T03:21:53.475ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "32a9dcdf-5a5d-4b9f-84c4-b52e52a31025", "content-length": "26", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
64092024-08-22T03:21:53.475ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64102024-08-22T03:21:53.477ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
64112024-08-22T03:21:53.477ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64122024-08-22T03:21:53.477ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "fc90f7f1-0bdc-4179-b62b-e50a5c966129", "content-length": "26", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
64132024-08-22T03:21:53.477ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64142024-08-22T03:21:53.478ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
64152024-08-22T03:21:53.479ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
64162024-08-22T03:21:53.485ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
64172024-08-22T03:21:53.486ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ca091b3f-a7ba-4e98-a671-0ac33734b23f", "content-length": "2", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
64182024-08-22T03:21:53.487ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64192024-08-22T03:21:53.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64202024-08-22T03:21:53.489ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 247.509182ms iteration = 20 status = null
64212024-08-22T03:21:53.519ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 278.055916ms iteration = 20 status = {}
64222024-08-22T03:21:53.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 48e6abb3-6ae0-4d38-a882-1134e587e95c roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64232024-08-22T03:21:53.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 48e6abb3-6ae0-4d38-a882-1134e587e95c resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64242024-08-22T03:21:53.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 48e6abb3-6ae0-4d38-a882-1134e587e95c response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64252024-08-22T03:21:53.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64262024-08-22T03:21:53.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64272024-08-22T03:21:53.582ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
64282024-08-22T03:21:53.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64292024-08-22T03:21:53.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64302024-08-22T03:21:53.588ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64312024-08-22T03:21:53.588ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "3c032b9e-d522-4072-914b-eb1d91c3fc44", "content-length": "121", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
64322024-08-22T03:21:53.588ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
64332024-08-22T03:21:53.588ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
64342024-08-22T03:21:53.588ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64352024-08-22T03:21:53.588ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
64362024-08-22T03:21:53.588ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
64372024-08-22T03:21:53.588ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
64382024-08-22T03:21:53.588ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
64392024-08-22T03:21:53.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64402024-08-22T03:21:53.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64412024-08-22T03:21:53.590ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
64422024-08-22T03:21:53.591ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6454b611-1e67-450e-8a6e-8aee6a6508cc", "content-length": "2", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
64432024-08-22T03:21:53.591ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
64442024-08-22T03:21:53.591ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "44a7a9b9-8f51-44ab-a316-7d780996e157", "content-length": "51", "date": "Thu, 22 Aug 2024 03:21:52 GMT"} })
64452024-08-22T03:21:53.591ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
64462024-08-22T03:21:53.591ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64472024-08-22T03:21:53.684ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "346ea471-4a74-4eae-8595-4b8cf67f673d", "date": "Thu, 22 Aug 2024 03:21:53 GMT"} })
64482024-08-22T03:21:53.684ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
64492024-08-22T03:21:53.684ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64502024-08-22T03:21:53.684ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "153cf2b0-8da8-4b5a-86b9-98357549f485", "content-length": "667", "date": "Thu, 22 Aug 2024 03:21:53 GMT"} })
64512024-08-22T03:21:53.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64522024-08-22T03:21:53.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64532024-08-22T03:21:53.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64542024-08-22T03:21:53.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64552024-08-22T03:21:53.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64562024-08-22T03:21:53.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64572024-08-22T03:21:53.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64582024-08-22T03:21:53.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64592024-08-22T03:21:53.699ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 453.890707ms iteration = 20 status = {}
64602024-08-22T03:21:54.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 830692ea-06a2-41f1-a9e1-6bd13dfd90d7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64612024-08-22T03:21:54.577ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 830692ea-06a2-41f1-a9e1-6bd13dfd90d7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64622024-08-22T03:21:54.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 830692ea-06a2-41f1-a9e1-6bd13dfd90d7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64632024-08-22T03:21:54.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1728 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 03f9b803-c420-4812-a502-7e76431087a4 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
64642024-08-22T03:21:55.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fc542da5-d08f-46ac-bace-f0710a0abc51 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64652024-08-22T03:21:55.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fc542da5-d08f-46ac-bace-f0710a0abc51 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64662024-08-22T03:21:55.601ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = fc542da5-d08f-46ac-bace-f0710a0abc51 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64672024-08-22T03:21:56.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 29c12c3b-f6c1-4d3a-bb83-acb74dadb889 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64682024-08-22T03:21:56.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 29c12c3b-f6c1-4d3a-bb83-acb74dadb889 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64692024-08-22T03:21:56.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 29c12c3b-f6c1-4d3a-bb83-acb74dadb889 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64702024-08-22T03:21:57.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e259deb0-fd9a-4a51-bc36-d37fd6d903fd roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64712024-08-22T03:21:57.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e259deb0-fd9a-4a51-bc36-d37fd6d903fd resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64722024-08-22T03:21:57.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e259deb0-fd9a-4a51-bc36-d37fd6d903fd response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64732024-08-22T03:21:58.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ba0f18b2-1026-4ff0-8cd0-f02a58d22cb5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64742024-08-22T03:21:58.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ba0f18b2-1026-4ff0-8cd0-f02a58d22cb5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64752024-08-22T03:21:58.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2228 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ba0f18b2-1026-4ff0-8cd0-f02a58d22cb5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64762024-08-22T03:21:59.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3f43efbe-4c6c-4bd9-9133-6bb3b41b1db7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64772024-08-22T03:21:59.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3f43efbe-4c6c-4bd9-9133-6bb3b41b1db7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64782024-08-22T03:21:59.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 3f43efbe-4c6c-4bd9-9133-6bb3b41b1db7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64792024-08-22T03:22:00.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 1502c68d-96bb-44e8-99dd-973f1c6db8a7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
64802024-08-22T03:22:00.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 1502c68d-96bb-44e8-99dd-973f1c6db8a7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
64812024-08-22T03:22:00.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 4042 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 1502c68d-96bb-44e8-99dd-973f1c6db8a7 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
64822024-08-22T03:22:00.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e34ca41d-0f32-4a4d-8a25-e06f91afa158 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64832024-08-22T03:22:00.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e34ca41d-0f32-4a4d-8a25-e06f91afa158 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64842024-08-22T03:22:00.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e34ca41d-0f32-4a4d-8a25-e06f91afa158 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64852024-08-22T03:22:01.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ad7abfd6-5d8c-4385-a54a-74b84eb02263 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64862024-08-22T03:22:01.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ad7abfd6-5d8c-4385-a54a-74b84eb02263 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64872024-08-22T03:22:01.729ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2757 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ad7abfd6-5d8c-4385-a54a-74b84eb02263 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64882024-08-22T03:22:02.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 668fd770-60de-431e-9f1c-8a3dfd1162a6 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64892024-08-22T03:22:02.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 668fd770-60de-431e-9f1c-8a3dfd1162a6 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64902024-08-22T03:22:02.750ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 668fd770-60de-431e-9f1c-8a3dfd1162a6 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
64912024-08-22T03:22:03.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
64922024-08-22T03:22:03.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64932024-08-22T03:22:03.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64942024-08-22T03:22:03.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64952024-08-22T03:22:03.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
64962024-08-22T03:22:03.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64972024-08-22T03:22:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64982024-08-22T03:22:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64992024-08-22T03:22:03.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65002024-08-22T03:22:03.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65012024-08-22T03:22:03.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65022024-08-22T03:22:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65032024-08-22T03:22:03.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65042024-08-22T03:22:03.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65052024-08-22T03:22:03.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.004848ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65062024-08-22T03:22:03.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65072024-08-22T03:22:03.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
65082024-08-22T03:22:03.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65092024-08-22T03:22:03.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65102024-08-22T03:22:03.257ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
65112024-08-22T03:22:03.257ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.351024ms iteration = 59 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
65122024-08-22T03:22:03.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 94e378d2-601f-4bcb-82f7-19b4ccf6f64b roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65132024-08-22T03:22:03.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 94e378d2-601f-4bcb-82f7-19b4ccf6f64b resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65142024-08-22T03:22:03.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 94e378d2-601f-4bcb-82f7-19b4ccf6f64b response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65152024-08-22T03:22:04.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1540 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = b600f0cb-e681-4d00-87ca-0325145ee9f8 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
65162024-08-22T03:22:04.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 817e5767-caa3-4882-8264-b92cc6f24b6f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65172024-08-22T03:22:04.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 817e5767-caa3-4882-8264-b92cc6f24b6f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65182024-08-22T03:22:04.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2584 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 817e5767-caa3-4882-8264-b92cc6f24b6f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65192024-08-22T03:22:05.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5b79c819-cec2-4560-ac68-70e9a98d2f52 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65202024-08-22T03:22:05.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5b79c819-cec2-4560-ac68-70e9a98d2f52 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65212024-08-22T03:22:05.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5b79c819-cec2-4560-ac68-70e9a98d2f52 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65222024-08-22T03:22:06.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e9262812-eb03-4fed-b316-dc801a1a2860 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65232024-08-22T03:22:06.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e9262812-eb03-4fed-b316-dc801a1a2860 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65242024-08-22T03:22:06.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1910 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e9262812-eb03-4fed-b316-dc801a1a2860 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65252024-08-22T03:22:07.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 457e6d69-dc0d-4e70-a6ca-34663704d73a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65262024-08-22T03:22:07.854ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 457e6d69-dc0d-4e70-a6ca-34663704d73a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65272024-08-22T03:22:07.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 457e6d69-dc0d-4e70-a6ca-34663704d73a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65282024-08-22T03:22:08.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b2a03fce-688f-4bb1-a456-5cd08e0c53ef roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65292024-08-22T03:22:08.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b2a03fce-688f-4bb1-a456-5cd08e0c53ef resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65302024-08-22T03:22:08.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b2a03fce-688f-4bb1-a456-5cd08e0c53ef response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65312024-08-22T03:22:09.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cc714b31-8798-4bdf-96df-182983d5f2a9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65322024-08-22T03:22:09.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cc714b31-8798-4bdf-96df-182983d5f2a9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65332024-08-22T03:22:09.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = cc714b31-8798-4bdf-96df-182983d5f2a9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65342024-08-22T03:22:10.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2b0d3027-f6e0-4ca0-be0a-f611e86b341a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65352024-08-22T03:22:10.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2b0d3027-f6e0-4ca0-be0a-f611e86b341a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65362024-08-22T03:22:10.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 2b0d3027-f6e0-4ca0-be0a-f611e86b341a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65372024-08-22T03:22:11.937ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 25133006-0226-4ae3-86f4-41cfe10e282f roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65382024-08-22T03:22:11.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 25133006-0226-4ae3-86f4-41cfe10e282f resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65392024-08-22T03:22:11.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2216 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 25133006-0226-4ae3-86f4-41cfe10e282f response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65402024-08-22T03:22:12.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0d9c0335-2e2d-4dad-8fbd-d7954677813d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65412024-08-22T03:22:12.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0d9c0335-2e2d-4dad-8fbd-d7954677813d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65422024-08-22T03:22:12.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0d9c0335-2e2d-4dad-8fbd-d7954677813d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65432024-08-22T03:22:13.242ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
65442024-08-22T03:22:13.242ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65452024-08-22T03:22:13.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65462024-08-22T03:22:13.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65472024-08-22T03:22:13.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
65482024-08-22T03:22:13.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65492024-08-22T03:22:13.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65502024-08-22T03:22:13.246ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65512024-08-22T03:22:13.246ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65522024-08-22T03:22:13.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65532024-08-22T03:22:13.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65542024-08-22T03:22:13.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65552024-08-22T03:22:13.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65562024-08-22T03:22:13.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65572024-08-22T03:22:13.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.965277ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65582024-08-22T03:22:13.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65592024-08-22T03:22:13.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
65602024-08-22T03:22:13.251ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65612024-08-22T03:22:13.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65622024-08-22T03:22:13.256ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
65632024-08-22T03:22:13.256ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 14.552323ms iteration = 60 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
65642024-08-22T03:22:13.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e969e874-b433-4a2c-bcaf-9cf0097488c4 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65652024-08-22T03:22:13.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e969e874-b433-4a2c-bcaf-9cf0097488c4 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65662024-08-22T03:22:13.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = e969e874-b433-4a2c-bcaf-9cf0097488c4 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65672024-08-22T03:22:14.600ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1526 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = b10b56fc-253e-448f-809d-886ca6ee824f response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
65682024-08-22T03:22:14.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 03d9ef52-1331-483a-a5cd-4f335614f097 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65692024-08-22T03:22:14.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 03d9ef52-1331-483a-a5cd-4f335614f097 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65702024-08-22T03:22:15.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 03d9ef52-1331-483a-a5cd-4f335614f097 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65712024-08-22T03:22:16.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 78072994-fab2-48fb-97db-de7df02eb7d9 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65722024-08-22T03:22:16.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 78072994-fab2-48fb-97db-de7df02eb7d9 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65732024-08-22T03:22:16.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 78072994-fab2-48fb-97db-de7df02eb7d9 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65742024-08-22T03:22:17.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22f9cf21-e2fa-4a6d-a7d5-6660f152d7ee roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65752024-08-22T03:22:17.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22f9cf21-e2fa-4a6d-a7d5-6660f152d7ee resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65762024-08-22T03:22:17.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 22f9cf21-e2fa-4a6d-a7d5-6660f152d7ee response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65772024-08-22T03:22:18.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c09601ed-75be-4638-b9f3-e26269ee61c5 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65782024-08-22T03:22:18.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c09601ed-75be-4638-b9f3-e26269ee61c5 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65792024-08-22T03:22:18.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2667 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = c09601ed-75be-4638-b9f3-e26269ee61c5 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65802024-08-22T03:22:19.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a76854d-a776-46eb-853a-cbc5a283d778 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65812024-08-22T03:22:19.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a76854d-a776-46eb-853a-cbc5a283d778 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65822024-08-22T03:22:19.084ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2259 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7a76854d-a776-46eb-853a-cbc5a283d778 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65832024-08-22T03:22:20.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b6a4a185-f673-45fd-b748-f08c74c5b6c0 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65842024-08-22T03:22:20.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b6a4a185-f673-45fd-b748-f08c74c5b6c0 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65852024-08-22T03:22:20.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2585 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b6a4a185-f673-45fd-b748-f08c74c5b6c0 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65862024-08-22T03:22:21.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 790a86ce-acdc-4d56-9087-c23ee184eb0d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65872024-08-22T03:22:21.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 790a86ce-acdc-4d56-9087-c23ee184eb0d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65882024-08-22T03:22:21.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 790a86ce-acdc-4d56-9087-c23ee184eb0d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65892024-08-22T03:22:22.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d9f1e728-4c54-46d1-a012-2ebc6e05619a roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65902024-08-22T03:22:22.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d9f1e728-4c54-46d1-a012-2ebc6e05619a resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65912024-08-22T03:22:22.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = d9f1e728-4c54-46d1-a012-2ebc6e05619a response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
65922024-08-22T03:22:22.239ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:64021
65932024-08-22T03:22:22.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64021 req_id = e6b811a9-248b-4e8f-9bf5-585e19254a93 roles = RoleSet { roles: {} } uri = /metrics/collectors/d035b4c1-6b21-454e-a5db-9173950866fd/producers?sort_by=id_ascending
65942024-08-22T03:22:22.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64021 req_id = e6b811a9-248b-4e8f-9bf5-585e19254a93 resource = Database result = Ok(()) uri = /metrics/collectors/d035b4c1-6b21-454e-a5db-9173950866fd/producers?sort_by=id_ascending
65952024-08-22T03:22:22.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 6630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64021 req_id = e6b811a9-248b-4e8f-9bf5-585e19254a93 response_code = 200 uri = /metrics/collectors/d035b4c1-6b21-454e-a5db-9173950866fd/producers?sort_by=id_ascending
65962024-08-22T03:22:22.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64021 req_id = 2e63ecee-a56a-44ff-9302-541f2406188d roles = RoleSet { roles: {} } uri = /metrics/collectors/d035b4c1-6b21-454e-a5db-9173950866fd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZTVmZTVhMC02NTIwLTQxMDgtOWNjMC1kYzE2ZGJlZmEzMWYifX0%3D
65972024-08-22T03:22:22.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64021 req_id = 2e63ecee-a56a-44ff-9302-541f2406188d resource = Database result = Ok(()) uri = /metrics/collectors/d035b4c1-6b21-454e-a5db-9173950866fd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZTVmZTVhMC02NTIwLTQxMDgtOWNjMC1kYzE2ZGJlZmEzMWYifX0%3D
65982024-08-22T03:22:22.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:64021 req_id = 2e63ecee-a56a-44ff-9302-541f2406188d response_code = 200 uri = /metrics/collectors/d035b4c1-6b21-454e-a5db-9173950866fd/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJlZTVmZTVhMC02NTIwLTQxMDgtOWNjMC1kYzE2ZGJlZmEzMWYifX0%3D
65992024-08-22T03:22:23.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1bb0033c-f23e-4ba5-9533-14a87713bb50 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
66002024-08-22T03:22:23.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1bb0033c-f23e-4ba5-9533-14a87713bb50 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
66012024-08-22T03:22:23.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 1bb0033c-f23e-4ba5-9533-14a87713bb50 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
66022024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
66032024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
66042024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66052024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
66062024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
66072024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66082024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66092024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66102024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
66112024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
66122024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
66132024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
66142024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66152024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66162024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
66172024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66182024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
66192024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
66202024-08-22T03:22:23.243ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-08-22 03:12:23.243250320 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66212024-08-22T03:22:23.243ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:80 reason = blueprint disabled target_id = bff907f0-2101-418e-8f5d-955661c8bd6f
66222024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
66232024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66242024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.25\u{b5}s iteration = 12 status = {"error":"blueprint disabled","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f"}
66252024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
66262024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66272024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66282024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
66292024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66302024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
66312024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
66322024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66332024-08-22T03:22:23.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66342024-08-22T03:22:23.243ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("1467044e-2fe8-4015-be86-a3faa36f1469.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("64fff417-46fd-44ed-ac7e-a3829d9efa54.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f44713a7-86d3-4345-91b6-2f7fff61d293.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 759384539 } })
66352024-08-22T03:22:23.243ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3ce7517f-82f9-4849-ad08-7cb0bf67f024.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("5a597bdf-a19f-4440-a5c9-c0ad27e590c2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 759392459 } })
66362024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Timeout
66372024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 4 reason = Timeout
66382024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66392024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
66402024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66412024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66422024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66432024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
66442024-08-22T03:22:23.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66452024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66462024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
66472024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
66482024-08-22T03:22:23.245ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
66492024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66502024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
66512024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66522024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66532024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
66542024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66552024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
66562024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66572024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
66582024-08-22T03:22:23.245ZINFOnexus (BackgroundTasks): Abandoned VMM reaper running background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:76
66592024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
66602024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
66612024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
66622024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66632024-08-22T03:22:23.245ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
66642024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66652024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66662024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
66672024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
66682024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
66692024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
66702024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
66712024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
66722024-08-22T03:22:23.245ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
66732024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66742024-08-22T03:22:23.245ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
66752024-08-22T03:22:23.245ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
66762024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66772024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
66782024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66792024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
66802024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66812024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.713724ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66822024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
66832024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66842024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.873756ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
66852024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66862024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
66872024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 3.004338ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
66882024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66892024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66902024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66912024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66922024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66932024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
66942024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
66952024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66962024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
66972024-08-22T03:22:23.246ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
66982024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66992024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67002024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67012024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67022024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67032024-08-22T03:22:23.246ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67042024-08-22T03:22:23.247ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-08-22 03:12:23.243250320 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67052024-08-22T03:22:23.247ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.837508ms iteration = 11 status = {"expiration":"2024-08-22T03:12:23.243250320Z","pruned":[]}
67062024-08-22T03:22:23.247ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 762709341 } })
67072024-08-22T03:22:23.247ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67082024-08-22T03:22:23.247ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67092024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67102024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67112024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67122024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67132024-08-22T03:22:23.248ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1050
67142024-08-22T03:22:23.248ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 763848875 } })
67152024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67162024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67172024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.855366ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
67182024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67192024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67202024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67212024-08-22T03:22:23.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67222024-08-22T03:22:23.249ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1050
67232024-08-22T03:22:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67242024-08-22T03:22:23.249ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67252024-08-22T03:22:23.249ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
67262024-08-22T03:22:23.249ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
67272024-08-22T03:22:23.249ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67282024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67292024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67302024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
67312024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67322024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0
67332024-08-22T03:22:23.250ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:189 found = 0 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0
67342024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 4.618338ms iteration = 11 status = {"error":null,"error_count":0,"found":0,"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0}
67352024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67362024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67372024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67382024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 4.864561ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
67392024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67402024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.145985ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67412024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67422024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67432024-08-22T03:22:23.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67442024-08-22T03:22:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67452024-08-22T03:22:23.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67462024-08-22T03:22:23.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67472024-08-22T03:22:23.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67482024-08-22T03:22:23.251ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67492024-08-22T03:22:23.251ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
67502024-08-22T03:22:23.251ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
67512024-08-22T03:22:23.251ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67522024-08-22T03:22:23.252ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67532024-08-22T03:22:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67542024-08-22T03:22:23.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67552024-08-22T03:22:23.252ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67562024-08-22T03:22:23.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67572024-08-22T03:22:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67582024-08-22T03:22:23.254ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67592024-08-22T03:22:23.254ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67602024-08-22T03:22:23.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67612024-08-22T03:22:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67622024-08-22T03:22:23.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67632024-08-22T03:22:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67642024-08-22T03:22:23.256ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
67652024-08-22T03:22:23.256ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67662024-08-22T03:22:23.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67672024-08-22T03:22:23.256ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67682024-08-22T03:22:23.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67692024-08-22T03:22:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67702024-08-22T03:22:23.257ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 11.559845ms iteration = 21 status = {"region_replacement_started_err":0,"region_replacement_started_ok":0}
67712024-08-22T03:22:23.257ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
67722024-08-22T03:22:23.257ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
67732024-08-22T03:22:23.257ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
67742024-08-22T03:22:23.257ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67752024-08-22T03:22:23.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67762024-08-22T03:22:23.260ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67772024-08-22T03:22:23.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67782024-08-22T03:22:23.260ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-08-22T03:22:23.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67802024-08-22T03:22:23.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67812024-08-22T03:22:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67822024-08-22T03:22:23.263ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67832024-08-22T03:22:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67842024-08-22T03:22:23.263ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67852024-08-22T03:22:23.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67862024-08-22T03:22:23.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67872024-08-22T03:22:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67882024-08-22T03:22:23.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67892024-08-22T03:22:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67902024-08-22T03:22:23.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67912024-08-22T03:22:23.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67922024-08-22T03:22:23.266ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:454 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67932024-08-22T03:22:23.266ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.65353ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67942024-08-22T03:22:23.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67952024-08-22T03:22:23.266ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 782265217 } })
67962024-08-22T03:22:23.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67972024-08-22T03:22:23.267ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1050 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
67982024-08-22T03:22:23.267ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67992024-08-22T03:22:23.267ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68002024-08-22T03:22:23.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68012024-08-22T03:22:23.268ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68022024-08-22T03:22:23.268ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 0 version = 2
68032024-08-22T03:22:23.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68042024-08-22T03:22:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68052024-08-22T03:22:23.268ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68062024-08-22T03:22:23.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68072024-08-22T03:22:23.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68082024-08-22T03:22:23.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68092024-08-22T03:22:23.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68102024-08-22T03:22:23.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68112024-08-22T03:22:23.269ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68122024-08-22T03:22:23.269ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68132024-08-22T03:22:23.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68142024-08-22T03:22:23.270ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:55
68152024-08-22T03:22:23.270ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:220 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68162024-08-22T03:22:23.270ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 24.69517ms iteration = 21 status = {"destroyed_active_vmms":0,"error":null,"saga_start_failures":0,"sagas_completed":0,"sagas_failed":0,"sagas_started":0,"terminated_active_migrations":0}
68172024-08-22T03:22:23.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68182024-08-22T03:22:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
68192024-08-22T03:22:23.271ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68202024-08-22T03:22:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68212024-08-22T03:22:23.271ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68222024-08-22T03:22:23.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68232024-08-22T03:22:23.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68242024-08-22T03:22:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
68252024-08-22T03:22:23.273ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68262024-08-22T03:22:23.273ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68272024-08-22T03:22:23.273ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68282024-08-22T03:22:23.273ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68292024-08-22T03:22:23.273ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68302024-08-22T03:22:23.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68312024-08-22T03:22:23.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68322024-08-22T03:22:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68332024-08-22T03:22:23.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68342024-08-22T03:22:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68352024-08-22T03:22:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68362024-08-22T03:22:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68372024-08-22T03:22:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68382024-08-22T03:22:23.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68392024-08-22T03:22:23.275ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68402024-08-22T03:22:23.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68412024-08-22T03:22:23.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68422024-08-22T03:22:23.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68432024-08-22T03:22:23.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68442024-08-22T03:22:23.277ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68452024-08-22T03:22:23.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68462024-08-22T03:22:23.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68472024-08-22T03:22:23.277ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68482024-08-22T03:22:23.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68492024-08-22T03:22:23.278ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
68502024-08-22T03:22:23.278ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 35.424055ms iteration = 61 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
68512024-08-22T03:22:23.278ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 34.433053ms iteration = 24 status = {"physical_disks_added":0}
68522024-08-22T03:22:23.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68532024-08-22T03:22:23.279ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 91a1ac8b-9d1f-44cc-b635-21a55a8df067 dns_zone_name = oxide.test found_so_far = 1 version = 2
68542024-08-22T03:22:23.279ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
68552024-08-22T03:22:23.279ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-08-22 03:13:03.125979 UTC dns_group = external generation = 2
68562024-08-22T03:22:23.279ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 36.243025ms iteration = 12 status = {"generation":2}
68572024-08-22T03:22:23.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68582024-08-22T03:22:23.280ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68592024-08-22T03:22:23.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
68602024-08-22T03:22:23.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68612024-08-22T03:22:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68622024-08-22T03:22:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68632024-08-22T03:22:23.281ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68642024-08-22T03:22:23.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68652024-08-22T03:22:23.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68662024-08-22T03:22:23.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68672024-08-22T03:22:23.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68682024-08-22T03:22:23.282ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68692024-08-22T03:22:23.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68702024-08-22T03:22:23.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68712024-08-22T03:22:23.283ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 405741c1-a688-40af-879c-a66a86eb2a8a dns_zone_name = control-plane.oxide.internal found_so_far = 50 version = 1
68722024-08-22T03:22:23.283ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
68732024-08-22T03:22:23.283ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-08-22 03:13:02.692706 UTC dns_group = internal generation = 1
68742024-08-22T03:22:23.283ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 40.52166ms iteration = 12 status = {"generation":1}
68752024-08-22T03:22:23.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68762024-08-22T03:22:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68772024-08-22T03:22:23.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68782024-08-22T03:22:23.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68792024-08-22T03:22:23.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68802024-08-22T03:22:23.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68812024-08-22T03:22:23.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68822024-08-22T03:22:23.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68832024-08-22T03:22:23.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68842024-08-22T03:22:23.287ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-08-22T03:12:22.052278Z, time_modified: 2024-08-22T03:12:22.052278Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, db_silo: Silo { identity: SiloIdentity { id: bb5b3233-d1df-448e-96fb-5a4c37e5412b, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-08-22T03:13:03.085429Z, time_modified: 2024-08-22T03:13:03.085429Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483" }] }) }
68852024-08-22T03:22:23.287ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 44.415928ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]}},"default_endpoint":{"silo_id":"bb5b3233-d1df-448e-96fb-5a4c37e5412b","tls_certs":["08d64db8f8c7f54448f5998490635068dd9f0c7aca2b26b72af785f95ef0d483"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68862024-08-22T03:22:23.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68872024-08-22T03:22:23.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68882024-08-22T03:22:23.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68892024-08-22T03:22:23.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68902024-08-22T03:22:23.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68912024-08-22T03:22:23.291ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
68922024-08-22T03:22:23.292ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68932024-08-22T03:22:23.292ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68942024-08-22T03:22:23.292ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 46.94413ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68952024-08-22T03:22:23.293ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
68962024-08-22T03:22:23.293ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
68972024-08-22T03:22:23.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
68982024-08-22T03:22:23.294ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 84e91024-81c4-4b2e-8f6a-8fe589e93fd8
68992024-08-22T03:22:23.294ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 8b746de4-b302-4f50-a980-a22c606e7413
69002024-08-22T03:22:23.294ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69012024-08-22T03:22:23.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69022024-08-22T03:22:23.295ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69032024-08-22T03:22:23.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69042024-08-22T03:22:23.297ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69052024-08-22T03:22:23.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69062024-08-22T03:22:23.298ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 6e75b8dd-e19e-4fe5-88a7-7d59903d4960
69072024-08-22T03:22:23.298ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
69082024-08-22T03:22:23.298ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
69092024-08-22T03:22:23.298ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 6e75b8dd-e19e-4fe5-88a7-7d59903d4960
69102024-08-22T03:22:23.298ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 83d39d43-9617-4649-9979-c84aeb9dcee3
69112024-08-22T03:22:23.298ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 84e91024-81c4-4b2e-8f6a-8fe589e93fd8
69122024-08-22T03:22:23.298ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 8b746de4-b302-4f50-a980-a22c606e7413
69132024-08-22T03:22:23.298ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = b8a19120-3bee-46ed-8e0a-5c18aa3f9273
69142024-08-22T03:22:23.298ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 52.691472ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":5,"recent_failures":[],"recent_recoveries":[]}
69152024-08-22T03:22:23.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69162024-08-22T03:22:23.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69172024-08-22T03:22:23.299ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69182024-08-22T03:22:23.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69192024-08-22T03:22:23.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69202024-08-22T03:22:23.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69212024-08-22T03:22:23.301ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69222024-08-22T03:22:23.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
69232024-08-22T03:22:23.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69242024-08-22T03:22:23.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69252024-08-22T03:22:23.306ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69262024-08-22T03:22:23.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69272024-08-22T03:22:23.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69282024-08-22T03:22:23.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69292024-08-22T03:22:23.308ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69302024-08-22T03:22:23.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
69312024-08-22T03:22:23.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69322024-08-22T03:22:23.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69332024-08-22T03:22:23.315ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69342024-08-22T03:22:23.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69352024-08-22T03:22:23.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69362024-08-22T03:22:23.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69372024-08-22T03:22:23.317ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69382024-08-22T03:22:23.317ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(3ad2aefb-ce72-45cc-b883-98ae232042fb, 0), (41a786c2-17e8-4991-b668-3c32ac490d97, 0), (6dddb5f9-4cbc-46ec-84d9-8410ccc45518, 0), (2ef118c2-ed78-4315-b007-74a2b7acb6b0, 0)] collection_id = 3ad2aefb-ce72-45cc-b883-98ae232042fb
69392024-08-22T03:22:23.317ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69402024-08-22T03:22:23.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69412024-08-22T03:22:23.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69422024-08-22T03:22:23.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69432024-08-22T03:22:23.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69442024-08-22T03:22:23.320ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69452024-08-22T03:22:23.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69462024-08-22T03:22:23.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69472024-08-22T03:22:23.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69482024-08-22T03:22:23.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69492024-08-22T03:22:23.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69502024-08-22T03:22:23.324ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69512024-08-22T03:22:23.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69522024-08-22T03:22:23.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69532024-08-22T03:22:23.328ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
69542024-08-22T03:22:23.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69552024-08-22T03:22:23.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69562024-08-22T03:22:23.329ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69572024-08-22T03:22:23.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69582024-08-22T03:22:23.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69592024-08-22T03:22:23.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69602024-08-22T03:22:23.331ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69612024-08-22T03:22:23.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
69622024-08-22T03:22:23.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69632024-08-22T03:22:23.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69642024-08-22T03:22:23.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69652024-08-22T03:22:23.340ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 53db6911-139a-448a-8c1b-7f8603cf520e, kind: Service { id: 3402f0c0-4afe-4d3a-ad22-fcd268662ca5 }, name: Name("nexus-3402f0c0-4afe-4d3a-ad22-fcd268662ca5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7758080c-490c-471f-9344-372483ce67bb, kind: Service { id: 3fd8dca3-b16c-4e0d-a7ea-81aa9fb66990 }, name: Name("nexus-3fd8dca3-b16c-4e0d-a7ea-81aa9fb66990"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 108])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cafe4faf-492c-4ce6-b87e-956f525f7351, kind: Service { id: 6704b89b-0851-45e8-ae6a-571db6735f05 }, name: Name("nexus-6704b89b-0851-45e8-ae6a-571db6735f05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0673aabd-3541-41cb-a886-23cdd3680f8f, kind: Service { id: 3ce7517f-82f9-4849-ad08-7cb0bf67f024 }, name: Name("external-dns-3ce7517f-82f9-4849-ad08-7cb0bf67f024"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 82])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ddeaf620-1944-4d2d-84d8-d718e3140255, kind: Service { id: 5a597bdf-a19f-4440-a5c9-c0ad27e590c2 }, name: Name("external-dns-5a597bdf-a19f-4440-a5c9-c0ad27e590c2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
69662024-08-22T03:22:23.340ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69672024-08-22T03:22:23.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69682024-08-22T03:22:23.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69692024-08-22T03:22:23.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69702024-08-22T03:22:23.341ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69712024-08-22T03:22:23.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69722024-08-22T03:22:23.342ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69732024-08-22T03:22:23.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
69742024-08-22T03:22:23.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69752024-08-22T03:22:23.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69762024-08-22T03:22:23.343ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
69772024-08-22T03:22:23.343ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0673aabd-3541-41cb-a886-23cdd3680f8f, kind: Service { id: 3ce7517f-82f9-4849-ad08-7cb0bf67f024 }, name: Name("external-dns-3ce7517f-82f9-4849-ad08-7cb0bf67f024"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 82])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ddeaf620-1944-4d2d-84d8-d718e3140255, kind: Service { id: 5a597bdf-a19f-4440-a5c9-c0ad27e590c2 }, name: Name("external-dns-5a597bdf-a19f-4440-a5c9-c0ad27e590c2"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 206, 105])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 53db6911-139a-448a-8c1b-7f8603cf520e, kind: Service { id: 3402f0c0-4afe-4d3a-ad22-fcd268662ca5 }, name: Name("nexus-3402f0c0-4afe-4d3a-ad22-fcd268662ca5"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7758080c-490c-471f-9344-372483ce67bb, kind: Service { id: 3fd8dca3-b16c-4e0d-a7ea-81aa9fb66990 }, name: Name("nexus-3fd8dca3-b16c-4e0d-a7ea-81aa9fb66990"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 170, 108])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cafe4faf-492c-4ce6-b87e-956f525f7351, kind: Service { id: 6704b89b-0851-45e8-ae6a-571db6735f05 }, name: Name("nexus-6704b89b-0851-45e8-ae6a-571db6735f05"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 165, 72])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
69782024-08-22T03:22:23.343ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
69792024-08-22T03:22:23.344ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
69802024-08-22T03:22:23.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69812024-08-22T03:22:23.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69822024-08-22T03:22:23.346ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.617705ms iteration = 21 status = 0
69832024-08-22T03:22:23.346ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 3ad2aefb-ce72-45cc-b883-98ae232042fb file = nexus/db-queries/src/db/datastore/inventory.rs:1299 ncabooses = 12 ncollections = 1 nerrors = 0 nnics = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
69842024-08-22T03:22:23.346ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
69852024-08-22T03:22:23.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
69862024-08-22T03:22:23.350ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(41a786c2-17e8-4991-b668-3c32ac490d97, 0), (6dddb5f9-4cbc-46ec-84d9-8410ccc45518, 0), (2ef118c2-ed78-4315-b007-74a2b7acb6b0, 0)]
69872024-08-22T03:22:23.351ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-ee5fe5a0-6520-4108-9cc0-dc16dbefa31f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 866563877 } })
69882024-08-22T03:22:23.365ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, time_created: 2024-08-22T03:12:55.365680Z, time_modified: 2024-08-22T03:12:55.365680Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::1:0, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
69892024-08-22T03:22:23.365ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
69902024-08-22T03:22:23.365ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69912024-08-22T03:22:23.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69922024-08-22T03:22:23.367ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
69932024-08-22T03:22:23.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
69942024-08-22T03:22:23.368ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69952024-08-22T03:22:23.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: ee5fe5a0-6520-4108-9cc0-dc16dbefa31f, lookup_type: ById(ee5fe5a0-6520-4108-9cc0-dc16dbefa31f) } result = Ok(())
69962024-08-22T03:22:23.435ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
69972024-08-22T03:22:23.435ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69982024-08-22T03:22:23.435ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a21fb29c-c58a-4114-9dc7-74e656821a0d", "content-length": "26", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
69992024-08-22T03:22:23.435ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70002024-08-22T03:22:23.437ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70012024-08-22T03:22:23.446ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
70022024-08-22T03:22:23.451ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
70032024-08-22T03:22:23.452ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1058 zone_address = fd00:1122:3344:101::2
70042024-08-22T03:22:23.452ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70052024-08-22T03:22:23.452ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ad204d35-b35e-47f8-bb71-42438cb309d2", "content-length": "26", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70062024-08-22T03:22:23.452ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1063 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70072024-08-22T03:22:23.454ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70082024-08-22T03:22:23.477ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70092024-08-22T03:22:23.477ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6838e441-7a61-4cce-b988-9459dbdcf3b7", "content-length": "372", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} })
70102024-08-22T03:22:23.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70112024-08-22T03:22:23.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70122024-08-22T03:22:23.479ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70132024-08-22T03:22:23.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70142024-08-22T03:22:23.480ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70152024-08-22T03:22:23.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70162024-08-22T03:22:23.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70172024-08-22T03:22:23.482ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 236.547464ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70182024-08-22T03:22:23.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70192024-08-22T03:22:23.484ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70202024-08-22T03:22:23.485ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = vpc_route_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc-routes", query: None, fragment: None }, status: 204, headers: {"x-request-id": "4d6f2b55-7a75-4f38-8b8a-605056a33dbf", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} })
70212024-08-22T03:22:23.487ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 241.398965ms iteration = 23 status = {}
70222024-08-22T03:22:23.574ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
70232024-08-22T03:22:23.575ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = service_firewall_rule_propagation result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", query: None, fragment: None }, status: 204, headers: {"x-request-id": "da19ce2e-2181-471b-850d-ec0dd39275df", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} })
70242024-08-22T03:22:23.576ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
70252024-08-22T03:22:23.576ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 330.814729ms
70262024-08-22T03:22:23.576ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 330.823019ms iteration = 3 status = {}
70272024-08-22T03:22:23.682ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1058 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f zone_address = fd00:1122:3344:101::2
70282024-08-22T03:22:23.682ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70292024-08-22T03:22:23.682ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/local/switch-id", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "11f49477-7001-44b3-a49b-acaca046547c", "content-length": "26", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70302024-08-22T03:22:23.682ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1063 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70312024-08-22T03:22:23.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1095 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
70322024-08-22T03:22:23.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
70332024-08-22T03:22:23.697ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::8)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6838a702-48c0-4b1b-aa9e-87da3116d9ad", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70342024-08-22T03:22:23.697ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70352024-08-22T03:22:23.699ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::9)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "45c04ac7-7252-4514-8419-51b09483a7d2", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70362024-08-22T03:22:23.699ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70372024-08-22T03:22:23.700ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
70382024-08-22T03:22:23.700ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 457.733424ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
70392024-08-22T03:22:23.706ZDEBGnexus (BackgroundTasks): client request SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70402024-08-22T03:22:23.706ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
70412024-08-22T03:22:23.707ZDEBGnexus (BackgroundTasks): client response SledAgent = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f background_task = v2p_manager result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/v2p", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ca53ac21-7b41-4b77-b3b2-69afe314df08", "content-length": "691", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} })
70422024-08-22T03:22:23.707ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
70432024-08-22T03:22:23.707ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
70442024-08-22T03:22:23.707ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
70452024-08-22T03:22:23.709ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 463.871272ms iteration = 22 status = {}
70462024-08-22T03:22:23.710ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 466.87917ms iteration = 21 status = {}
70472024-08-22T03:22:23.725ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
70482024-08-22T03:22:23.725ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
70492024-08-22T03:22:23.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
70502024-08-22T03:22:23.725ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/ignition", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "8f1ee3d1-c0ce-4131-9d5b-5b7287f17caa", "content-length": "476", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70512024-08-22T03:22:23.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
70522024-08-22T03:22:23.725ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "e9fc2910-3032-4180-ad26-62d0e5ca9b49", "content-length": "734", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70532024-08-22T03:22:23.725ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
70542024-08-22T03:22:23.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "346a7e83-d16e-4500-b7cc-d925504e01b6", "content-length": "86", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70552024-08-22T03:22:23.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
70562024-08-22T03:22:23.726ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "33244ed6-22b4-4c16-96a6-d7d0e9cf693d", "content-length": "86", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70572024-08-22T03:22:23.726ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
70582024-08-22T03:22:23.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "306f8875-95ab-453d-81f9-e93053b70dfa", "content-length": "80", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70592024-08-22T03:22:23.727ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
70602024-08-22T03:22:23.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "2f1584bf-8d6b-44b4-91b0-39ac3338e460", "content-length": "80", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70612024-08-22T03:22:23.727ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
70622024-08-22T03:22:23.727ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "5c70408c-49a8-4322-b771-aca6f5f24ae6", "content-length": "88", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70632024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
70642024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "9ab768bf-27e0-488f-b853-206600f43707", "content-length": "88", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70652024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
70662024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7a0f2f94-a4d3-483e-ae17-40b6505da097", "content-length": "702", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70672024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
70682024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a933681a-95d0-4b24-8467-31c5fa0c6130", "content-length": "727", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70692024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
70702024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "af66a4cb-011d-4a82-bea3-85ff942db794", "content-length": "729", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70712024-08-22T03:22:23.728ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
70722024-08-22T03:22:23.729ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/switch/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "7e362a07-22b1-4f29-938f-88bfe733ab60", "content-length": "728", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70732024-08-22T03:22:23.729ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
70742024-08-22T03:22:23.729ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "ffe3140c-b25b-4a1d-a553-15c2b00b85bb", "content-length": "722", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70752024-08-22T03:22:23.729ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
70762024-08-22T03:22:23.729ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "f4040eed-a311-45e0-b71d-932b162852e0", "content-length": "84", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70772024-08-22T03:22:23.729ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
70782024-08-22T03:22:23.730ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/sp/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "54a18c2b-6e53-4b9d-a3de-95501bc4e05e", "content-length": "84", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70792024-08-22T03:22:23.730ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
70802024-08-22T03:22:23.730ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "6f02fbd5-e026-4d46-abb2-a5a39d3fd644", "content-length": "82", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70812024-08-22T03:22:23.730ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
70822024-08-22T03:22:23.730ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d30253dd-0d2a-4b4f-975d-97c7c0a661c1", "content-length": "82", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70832024-08-22T03:22:23.730ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
70842024-08-22T03:22:23.731ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=0"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "eb45a958-19b4-459d-8c05-916f7d04281d", "content-length": "91", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70852024-08-22T03:22:23.731ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
70862024-08-22T03:22:23.731ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/stage0/caboose", query: Some("firmware_slot=1"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "dc3671a8-bcd0-4976-8971-3db5779f2e64", "content-length": "91", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70872024-08-22T03:22:23.731ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
70882024-08-22T03:22:23.731ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cmpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "b7f67625-14fb-4d40-9a82-2a2edff763c0", "content-length": "702", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70892024-08-22T03:22:23.731ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
70902024-08-22T03:22:23.731ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d2d58811-7697-416d-aa7f-dbb885594e61", "content-length": "727", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70912024-08-22T03:22:23.731ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
70922024-08-22T03:22:23.732ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d7656442-1770-44e9-8748-2f1de33066f2", "content-length": "729", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70932024-08-22T03:22:23.732ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
70942024-08-22T03:22:23.732ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12225), path: "/sp/sled/0/component/rot/cfpa", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "1aa860f0-345f-4200-b2fc-68052850072e", "content-length": "728", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
70952024-08-22T03:22:23.732ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
70962024-08-22T03:22:23.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
70972024-08-22T03:22:23.734ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70982024-08-22T03:22:23.735ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
70992024-08-22T03:22:23.735ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71002024-08-22T03:22:23.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71012024-08-22T03:22:23.736ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71022024-08-22T03:22:23.738ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
71032024-08-22T03:22:23.738ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71042024-08-22T03:22:23.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71052024-08-22T03:22:23.741ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
71062024-08-22T03:22:23.741ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/rpw/nat/ipv4/gen", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "a5dc91b0-3119-4c14-b053-d2246d680b92", "content-length": "2", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
71072024-08-22T03:22:23.743ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71082024-08-22T03:22:23.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71092024-08-22T03:22:23.745ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 502.233444ms iteration = 21 status = null
71102024-08-22T03:22:23.803ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
71112024-08-22T03:22:23.804ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:1::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "fbfecc40-fcc6-4084-9843-9ab1b597a514", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71122024-08-22T03:22:23.804ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71132024-08-22T03:22:23.806ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:3::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "b1c2e6d7-ab6f-4cf8-ac47-3b322b16b560", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71142024-08-22T03:22:23.806ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71152024-08-22T03:22:23.808ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:2::1)), port: Some(5353), path: "/config", query: None, fragment: None }, status: 204, headers: {"x-request-id": "6f79b0f7-37ba-40cd-bfab-b26875db65d4", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71162024-08-22T03:22:23.808ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71172024-08-22T03:22:23.810ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
71182024-08-22T03:22:23.810ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 567.694847ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
71192024-08-22T03:22:23.824ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
71202024-08-22T03:22:23.824ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
71212024-08-22T03:22:23.873ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71222024-08-22T03:22:23.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71232024-08-22T03:22:23.876ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:147 port = SwitchPort { id: eb7704ad-4e93-45cc-b83a-8c155137d4df, rack_id: f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(adda8dba-223a-4623-a5e1-b2185478327c) } rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
71242024-08-22T03:22:23.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71252024-08-22T03:22:23.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71262024-08-22T03:22:23.883ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71272024-08-22T03:22:23.883ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/port/qsfp0/settings", query: Some("tag=omicron"), fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "d265e4cc-9149-458c-b9c6-8b4263848a2b", "content-length": "121", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
71282024-08-22T03:22:23.883ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1714 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G } }} } switch_port_id = "qsfp0"
71292024-08-22T03:22:23.883ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = adda8dba-223a-4623-a5e1-b2185478327c
71302024-08-22T03:22:23.883ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:379 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71312024-08-22T03:22:23.883ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71322024-08-22T03:22:23.883ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:392 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
71332024-08-22T03:22:23.883ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:398 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f routes = {}
71342024-08-22T03:22:23.883ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:418 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f
71352024-08-22T03:22:23.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71362024-08-22T03:22:23.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71372024-08-22T03:22:23.885ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71382024-08-22T03:22:23.885ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv4", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "4600f3f3-94c8-448c-8e2e-b15aae7efd18", "content-length": "2", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
71392024-08-22T03:22:23.885ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71402024-08-22T03:22:23.885ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::2)), port: Some(12224), path: "/loopback/ipv6", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "45d8d31b-c1b3-4963-a1af-5ca2234b7783", "content-length": "51", "date": "Thu, 22 Aug 2024 03:22:22 GMT"} })
71412024-08-22T03:22:23.885ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0" }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:467 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch_location = Switch0
71422024-08-22T03:22:23.885ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71432024-08-22T03:22:23.913ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/inventory", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "0ae3f49f-8465-4869-a8cc-512089f1b631", "content-length": "2362", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} })
71442024-08-22T03:22:23.913ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/omicron-zones
71452024-08-22T03:22:23.919ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/omicron-zones", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "32848a08-7265-46d0-9df0-f91958d773ea", "content-length": "10314", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} })
71462024-08-22T03:22:23.922ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
71472024-08-22T03:22:23.922ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71482024-08-22T03:22:23.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71492024-08-22T03:22:23.923ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71502024-08-22T03:22:23.925ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
71512024-08-22T03:22:23.927ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
71522024-08-22T03:22:23.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
71532024-08-22T03:22:24.006ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/switch-ports", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f2b3f688-f8e3-4b53-b7d8-4d84395fda4c", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} })
71542024-08-22T03:22:24.006ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:770 rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f switch = Switch0
71552024-08-22T03:22:24.006ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71562024-08-22T03:22:24.006ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = f3acf7ab-cbe9-4d3f-a5b0-4e10d6c07c3f result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::1)), port: Some(12345), path: "/network-bootstore-config", query: None, fragment: None }, status: 200, headers: {"content-type": "application/json", "x-request-id": "10b57036-bd76-4c41-9e75-0a8064494fdb", "content-length": "667", "date": "Thu, 22 Aug 2024 03:22:23 GMT"} })
71572024-08-22T03:22:24.006ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71582024-08-22T03:22:24.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71592024-08-22T03:22:24.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71602024-08-22T03:22:24.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71612024-08-22T03:22:24.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71622024-08-22T03:22:24.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71632024-08-22T03:22:24.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71642024-08-22T03:22:24.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71652024-08-22T03:22:24.021ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 775.323388ms iteration = 21 status = {}
71662024-08-22T03:22:24.048ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = e0c3ab10-0008-4d50-aecb-08a7e74396fb file = nexus/db-queries/src/db/datastore/inventory.rs:893
71672024-08-22T03:22:24.050ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = e0c3ab10-0008-4d50-aecb-08a7e74396fb time_started = 2024-08-22 03:22:23.725213 UTC
71682024-08-22T03:22:24.050ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 806.167555ms iteration = 4 status = {"collection_id":"e0c3ab10-0008-4d50-aecb-08a7e74396fb","time_done":"2024-08-22 03:22:23.922111 UTC","time_started":"2024-08-22 03:22:23.725213 UTC"}
71692024-08-22T03:22:24.050ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Dependency
71702024-08-22T03:22:24.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71712024-08-22T03:22:24.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71722024-08-22T03:22:24.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71732024-08-22T03:22:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71742024-08-22T03:22:24.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71752024-08-22T03:22:24.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71762024-08-22T03:22:24.055ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71772024-08-22T03:22:24.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71782024-08-22T03:22:24.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71792024-08-22T03:22:24.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71802024-08-22T03:22:24.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71812024-08-22T03:22:24.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71822024-08-22T03:22:24.066ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 15.599596ms iteration = 25 status = {"physical_disks_added":0}
71832024-08-22T03:22:24.071ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:47768
71842024-08-22T03:22:24.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47768 req_id = df00a026-f12d-4869-817b-688d398f0c17 roles = RoleSet { roles: {} } uri = /metrics/producers
71852024-08-22T03:22:24.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47768 req_id = df00a026-f12d-4869-817b-688d398f0c17 resource = Database result = Ok(()) uri = /metrics/producers
71862024-08-22T03:22:24.103ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
71872024-08-22T03:22:24.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47768 req_id = df00a026-f12d-4869-817b-688d398f0c17 roles = RoleSet { roles: {} } uri = /metrics/producers
71882024-08-22T03:22:24.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47768 req_id = df00a026-f12d-4869-817b-688d398f0c17 resource = Database result = Ok(()) uri = /metrics/producers
71892024-08-22T03:22:24.110ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
71902024-08-22T03:22:24.110ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "7957ff73-f1f7-45d2-b660-80f25874e8d8", "date": "Thu, 22 Aug 2024 03:22:24 GMT"} })
71912024-08-22T03:22:24.110ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = e4d9dca8-f487-4ba1-85b6-d674be01f3cb
71922024-08-22T03:22:24.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40398 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47768 req_id = df00a026-f12d-4869-817b-688d398f0c17 response_code = 201 uri = /metrics/producers
71932024-08-22T03:22:24.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0ccd3429-67c7-456c-9a5f-e9aafb420a00 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
71942024-08-22T03:22:24.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0ccd3429-67c7-456c-9a5f-e9aafb420a00 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
71952024-08-22T03:22:24.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1938 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0ccd3429-67c7-456c-9a5f-e9aafb420a00 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
71962024-08-22T03:22:25.134ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:49496
71972024-08-22T03:22:25.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49496 req_id = 269680d5-96b6-4ef2-8788-bb87c61b1813 roles = RoleSet { roles: {} } uri = /metrics/producers
71982024-08-22T03:22:25.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49496 req_id = 269680d5-96b6-4ef2-8788-bb87c61b1813 resource = Database result = Ok(()) uri = /metrics/producers
71992024-08-22T03:22:25.167ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
72002024-08-22T03:22:25.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49496 req_id = 269680d5-96b6-4ef2-8788-bb87c61b1813 roles = RoleSet { roles: {} } uri = /metrics/producers
72012024-08-22T03:22:25.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49496 req_id = 269680d5-96b6-4ef2-8788-bb87c61b1813 resource = Database result = Ok(()) uri = /metrics/producers
72022024-08-22T03:22:25.173ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
72032024-08-22T03:22:25.173ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "2bdca2d6-401f-408a-9fcc-2e2d24aa153e", "date": "Thu, 22 Aug 2024 03:22:25 GMT"} })
72042024-08-22T03:22:25.173ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72052024-08-22T03:22:25.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 40138 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49496 req_id = 269680d5-96b6-4ef2-8788-bb87c61b1813 response_code = 201 uri = /metrics/producers
72062024-08-22T03:22:25.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 847ae5c1-1cfd-4583-9612-eec35c590737 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72072024-08-22T03:22:25.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 847ae5c1-1cfd-4583-9612-eec35c590737 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72082024-08-22T03:22:25.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 847ae5c1-1cfd-4583-9612-eec35c590737 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72092024-08-22T03:22:26.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = feecb827-c889-4882-8410-ff4ce477c449 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72102024-08-22T03:22:26.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = feecb827-c889-4882-8410-ff4ce477c449 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72112024-08-22T03:22:26.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = feecb827-c889-4882-8410-ff4ce477c449 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72122024-08-22T03:22:26.607ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:53055
72132024-08-22T03:22:26.607ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53055 req_id = 98467720-cb24-48d9-a912-697e80c4506c roles = RoleSet { roles: {} } uri = /metrics/producers
72142024-08-22T03:22:26.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53055 req_id = 98467720-cb24-48d9-a912-697e80c4506c resource = Database result = Ok(()) uri = /metrics/producers
72152024-08-22T03:22:26.640ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
72162024-08-22T03:22:26.640ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53055 req_id = 98467720-cb24-48d9-a912-697e80c4506c roles = RoleSet { roles: {} } uri = /metrics/producers
72172024-08-22T03:22:26.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53055 req_id = 98467720-cb24-48d9-a912-697e80c4506c resource = Database result = Ok(()) uri = /metrics/producers
72182024-08-22T03:22:26.648ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
72192024-08-22T03:22:26.649ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f0cf10fa-4446-4a45-ae91-e644e382d375", "date": "Thu, 22 Aug 2024 03:22:26 GMT"} })
72202024-08-22T03:22:26.649ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = 23048a74-7858-48f9-b45b-63d0f73fea5c
72212024-08-22T03:22:26.651ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 43229 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53055 req_id = 98467720-cb24-48d9-a912-697e80c4506c response_code = 201 uri = /metrics/producers
72222024-08-22T03:22:27.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f432fd6-db45-4844-8cba-b04e0218229d roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72232024-08-22T03:22:27.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f432fd6-db45-4844-8cba-b04e0218229d resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72242024-08-22T03:22:27.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f432fd6-db45-4844-8cba-b04e0218229d response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72252024-08-22T03:22:27.590ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:35338
72262024-08-22T03:22:27.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35338 req_id = b04a97c6-bfb1-43ff-a037-76d39d0d1e07 roles = RoleSet { roles: {} } uri = /metrics/producers
72272024-08-22T03:22:27.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35338 req_id = b04a97c6-bfb1-43ff-a037-76d39d0d1e07 resource = Database result = Ok(()) uri = /metrics/producers
72282024-08-22T03:22:27.622ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
72292024-08-22T03:22:27.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35338 req_id = b04a97c6-bfb1-43ff-a037-76d39d0d1e07 roles = RoleSet { roles: {} } uri = /metrics/producers
72302024-08-22T03:22:27.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35338 req_id = b04a97c6-bfb1-43ff-a037-76d39d0d1e07 resource = Database result = Ok(()) uri = /metrics/producers
72312024-08-22T03:22:27.628ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
72322024-08-22T03:22:27.628ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "f1a24ba4-f413-4ad0-8be3-4829415779a4", "date": "Thu, 22 Aug 2024 03:22:27 GMT"} })
72332024-08-22T03:22:27.628ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = ce6ae16f-249c-4cde-9f29-e4f137631a2e
72342024-08-22T03:22:27.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39223 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:35338 req_id = b04a97c6-bfb1-43ff-a037-76d39d0d1e07 response_code = 201 uri = /metrics/producers
72352024-08-22T03:22:28.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f777dfc-902e-4a58-aa53-b7f2e6f19bb7 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72362024-08-22T03:22:28.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f777dfc-902e-4a58-aa53-b7f2e6f19bb7 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72372024-08-22T03:22:28.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0f777dfc-902e-4a58-aa53-b7f2e6f19bb7 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72382024-08-22T03:22:29.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ed03b44c-7b27-4c8e-8b37-bd5dccca22bc roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72392024-08-22T03:22:29.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ed03b44c-7b27-4c8e-8b37-bd5dccca22bc resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72402024-08-22T03:22:29.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = ed03b44c-7b27-4c8e-8b37-bd5dccca22bc response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72412024-08-22T03:22:30.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 00ff75cc-2a10-42ec-bf1c-df4f1b5e8054 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/12?limit=100
72422024-08-22T03:22:30.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 00ff75cc-2a10-42ec-bf1c-df4f1b5e8054 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/12?limit=100
72432024-08-22T03:22:30.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:46616 req_id = 00ff75cc-2a10-42ec-bf1c-df4f1b5e8054 response_code = 200 uri = /nat/ipv4/changeset/12?limit=100
72442024-08-22T03:22:30.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7bfe49e9-7290-4d97-b01c-1c64db6ee631 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72452024-08-22T03:22:30.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7bfe49e9-7290-4d97-b01c-1c64db6ee631 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72462024-08-22T03:22:30.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 7bfe49e9-7290-4d97-b01c-1c64db6ee631 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72472024-08-22T03:22:31.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0176cb38-f0df-4a65-814c-89bcd6677e81 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72482024-08-22T03:22:31.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0176cb38-f0df-4a65-814c-89bcd6677e81 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72492024-08-22T03:22:31.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 0176cb38-f0df-4a65-814c-89bcd6677e81 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72502024-08-22T03:22:32.207ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:775 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:34291
72512024-08-22T03:22:32.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34291 req_id = 03bf9edc-4027-4fd0-8dc4-42793d2d2209 roles = RoleSet { roles: {} } uri = /metrics/producers
72522024-08-22T03:22:32.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34291 req_id = 03bf9edc-4027-4fd0-8dc4-42793d2d2209 resource = Database result = Ok(()) uri = /metrics/producers
72532024-08-22T03:22:32.240ZINFOnexus: registered oximeter collector client file = nexus/src/app/oximeter.rs:338 id = d035b4c1-6b21-454e-a5db-9173950866fd
72542024-08-22T03:22:32.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34291 req_id = 03bf9edc-4027-4fd0-8dc4-42793d2d2209 roles = RoleSet { roles: {} } uri = /metrics/producers
72552024-08-22T03:22:32.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34291 req_id = 03bf9edc-4027-4fd0-8dc4-42793d2d2209 resource = Database result = Ok(()) uri = /metrics/producers
72562024-08-22T03:22:32.245ZDEBGnexus: client request body = Some(Body) method = POST oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd uri = http://[fd00:1122:3344:101::d]:12223/producers
72572024-08-22T03:22:32.246ZDEBGnexus: client response oximeter-collector = d035b4c1-6b21-454e-a5db-9173950866fd result = Ok(Response { url: Url { scheme: "http", cannot_be_a_base: false, username: "", password: None, host: Some(Ipv6(fd00:1122:3344:101::d)), port: Some(12223), path: "/producers", query: None, fragment: None }, status: 204, headers: {"x-request-id": "bb699292-9e29-40de-b5be-997259b72f24", "date": "Thu, 22 Aug 2024 03:22:32 GMT"} })
72582024-08-22T03:22:32.246ZINFOnexus: assigned collector to new producer collector_id = d035b4c1-6b21-454e-a5db-9173950866fd file = nexus/src/app/oximeter.rs:125 producer_id = b136e605-e6c0-4cdf-94cc-94880650b9fc
72592024-08-22T03:22:32.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 39690 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34291 req_id = 03bf9edc-4027-4fd0-8dc4-42793d2d2209 response_code = 201 uri = /metrics/producers
72602024-08-22T03:22:32.265ZINFOnexus (dropshot): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2054 local_addr = [fd00:1122:3344:101::b]:48531 method = GET remote_addr = [fd00:1122:3344:101::d]:54593 req_id = 9c2226f2-888b-4bc6-9dde-58ed2c79d740 response_code = 200 uri = /3402f0c0-4afe-4d3a-ad22-fcd268662ca5
72612024-08-22T03:22:32.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b8434450-42b7-463f-8763-98cefa026512 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72622024-08-22T03:22:32.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b8434450-42b7-463f-8763-98cefa026512 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72632024-08-22T03:22:32.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = b8434450-42b7-463f-8763-98cefa026512 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72642024-08-22T03:22:33.243ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
72652024-08-22T03:22:33.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72662024-08-22T03:22:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72672024-08-22T03:22:33.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72682024-08-22T03:22:33.246ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
72692024-08-22T03:22:33.246ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72702024-08-22T03:22:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72712024-08-22T03:22:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72722024-08-22T03:22:33.247ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72732024-08-22T03:22:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72742024-08-22T03:22:33.247ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72752024-08-22T03:22:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72762024-08-22T03:22:33.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72772024-08-22T03:22:33.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72782024-08-22T03:22:33.249ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.867057ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72792024-08-22T03:22:33.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72802024-08-22T03:22:33.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: bff907f0-2101-418e-8f5d-955661c8bd6f, lookup_type: ById(bff907f0-2101-418e-8f5d-955661c8bd6f) } result = Ok(())
72812024-08-22T03:22:33.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72822024-08-22T03:22:33.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72832024-08-22T03:22:33.258ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = bff907f0-2101-418e-8f5d-955661c8bd6f original_time_created = 2024-08-22 03:12:14.826259 UTC target_id = bff907f0-2101-418e-8f5d-955661c8bd6f time_created = 2024-08-22 03:12:14.826259 UTC
72842024-08-22T03:22:33.258ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.528365ms iteration = 62 status = {"status":"target blueprint unchanged","target_id":"bff907f0-2101-418e-8f5d-955661c8bd6f","time_created":"2024-08-22T03:12:14.826259Z"}
72852024-08-22T03:22:33.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6c54c2cf-35d5-475b-82c7-e7cc7daf6617 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72862024-08-22T03:22:33.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6c54c2cf-35d5-475b-82c7-e7cc7daf6617 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72872024-08-22T03:22:33.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 1646 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 6c54c2cf-35d5-475b-82c7-e7cc7daf6617 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72882024-08-22T03:22:34.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 091dbe23-cc9a-43e6-b2d1-5c58565f03c1 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72892024-08-22T03:22:34.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 091dbe23-cc9a-43e6-b2d1-5c58565f03c1 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72902024-08-22T03:22:34.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 3097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 091dbe23-cc9a-43e6-b2d1-5c58565f03c1 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72912024-08-22T03:22:35.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5bc68fc8-608d-4bfb-b076-f8aafb4367d8 roles = RoleSet { roles: {} } uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72922024-08-22T03:22:35.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5bc68fc8-608d-4bfb-b076-f8aafb4367d8 resource = Database result = Ok(()) uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f
72932024-08-22T03:22:35.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/git/checkouts/dropshot-a4a923d29dccc492/06c8dab/dropshot/src/server.rs:914 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36401 req_id = 5bc68fc8-608d-4bfb-b076-f8aafb4367d8 response_code = 200 uri = /probes/ee5fe5a0-6520-4108-9cc0-dc16dbefa31f