Max level shown:
12024-11-22T04:00:01.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5508fd27-d842-4455-814c-a939c81812c3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22024-11-22T04:00:01.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5508fd27-d842-4455-814c-a939c81812c3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32024-11-22T04:00:01.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2777 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5508fd27-d842-4455-814c-a939c81812c3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
42024-11-22T04:00:02.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c08f9fb6-d392-4dbb-872e-9ab372089238 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52024-11-22T04:00:02.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c08f9fb6-d392-4dbb-872e-9ab372089238 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
62024-11-22T04:00:02.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2832 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c08f9fb6-d392-4dbb-872e-9ab372089238 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
72024-11-22T04:00:03.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be078d89-de07-47d8-9997-cd6b43e170c3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82024-11-22T04:00:03.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be078d89-de07-47d8-9997-cd6b43e170c3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92024-11-22T04:00:03.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be078d89-de07-47d8-9997-cd6b43e170c3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
102024-11-22T04:00:04.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b491517-ac47-4a90-acc9-b8b77bbf0361 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
112024-11-22T04:00:04.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b491517-ac47-4a90-acc9-b8b77bbf0361 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
122024-11-22T04:00:04.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b491517-ac47-4a90-acc9-b8b77bbf0361 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
132024-11-22T04:00:05.733ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d82c1525-3660-4606-b759-be6fba6d481a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
142024-11-22T04:00:05.734ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d82c1525-3660-4606-b759-be6fba6d481a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
152024-11-22T04:00:05.735ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d82c1525-3660-4606-b759-be6fba6d481a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
162024-11-22T04:00:06.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ccde1d92-73f6-4cf9-910e-cbb305b9db8e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
172024-11-22T04:00:06.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ccde1d92-73f6-4cf9-910e-cbb305b9db8e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
182024-11-22T04:00:06.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ccde1d92-73f6-4cf9-910e-cbb305b9db8e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
192024-11-22T04:00:07.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 40394869-f0f3-4275-af19-e23ceb536b12 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
202024-11-22T04:00:07.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 40394869-f0f3-4275-af19-e23ceb536b12 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
212024-11-22T04:00:07.777ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 40394869-f0f3-4275-af19-e23ceb536b12 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
222024-11-22T04:00:08.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
232024-11-22T04:00:08.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
242024-11-22T04:00:08.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
252024-11-22T04:00:08.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
262024-11-22T04:00:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
272024-11-22T04:00:08.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
282024-11-22T04:00:08.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
292024-11-22T04:00:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
302024-11-22T04:00:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
312024-11-22T04:00:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
322024-11-22T04:00:08.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
332024-11-22T04:00:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
342024-11-22T04:00:08.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
352024-11-22T04:00:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
362024-11-22T04:00:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
372024-11-22T04:00:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
382024-11-22T04:00:08.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
392024-11-22T04:00:08.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.950186ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
402024-11-22T04:00:08.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
412024-11-22T04:00:08.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
422024-11-22T04:00:08.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.51038ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
432024-11-22T04:00:08.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6ee182c7-2c52-46b7-93cf-729fc900f1b1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
442024-11-22T04:00:08.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6ee182c7-2c52-46b7-93cf-729fc900f1b1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
452024-11-22T04:00:08.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1750 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6ee182c7-2c52-46b7-93cf-729fc900f1b1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
462024-11-22T04:00:09.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f5388cbe-9568-4978-a1fb-59750f3b7209 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
472024-11-22T04:00:09.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f5388cbe-9568-4978-a1fb-59750f3b7209 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
482024-11-22T04:00:09.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1838 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f5388cbe-9568-4978-a1fb-59750f3b7209 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
492024-11-22T04:00:10.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 5de6782a-1fff-4901-b8d8-65e2f066c5be roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
502024-11-22T04:00:10.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 5de6782a-1fff-4901-b8d8-65e2f066c5be resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
512024-11-22T04:00:10.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2930 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 5de6782a-1fff-4901-b8d8-65e2f066c5be response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
522024-11-22T04:00:10.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 57c5c047-10e5-49c8-8e13-07d5cb55e7ba roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
532024-11-22T04:00:10.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 57c5c047-10e5-49c8-8e13-07d5cb55e7ba resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
542024-11-22T04:00:10.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2608 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 57c5c047-10e5-49c8-8e13-07d5cb55e7ba response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
552024-11-22T04:00:10.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 509 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = a373971f-f7d4-4702-a891-f3019a8e7416 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
562024-11-22T04:00:10.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b43c9db8-92b6-433c-a849-23f878a3d372 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
572024-11-22T04:00:10.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b43c9db8-92b6-433c-a849-23f878a3d372 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
582024-11-22T04:00:10.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1687 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b43c9db8-92b6-433c-a849-23f878a3d372 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
592024-11-22T04:00:11.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cbdd032a-28ed-4696-a1c9-5b744dd64284 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
602024-11-22T04:00:11.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cbdd032a-28ed-4696-a1c9-5b744dd64284 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
612024-11-22T04:00:11.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1868 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cbdd032a-28ed-4696-a1c9-5b744dd64284 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
622024-11-22T04:00:12.878ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3607f5a8-e60a-473d-96d0-7616af4e1036 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
632024-11-22T04:00:12.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3607f5a8-e60a-473d-96d0-7616af4e1036 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
642024-11-22T04:00:12.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3607f5a8-e60a-473d-96d0-7616af4e1036 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
652024-11-22T04:00:13.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 906a2018-49e1-47d7-8005-1c43b64cfdc3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
662024-11-22T04:00:13.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 906a2018-49e1-47d7-8005-1c43b64cfdc3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
672024-11-22T04:00:13.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 906a2018-49e1-47d7-8005-1c43b64cfdc3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
682024-11-22T04:00:14.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3715b581-8ce0-42c2-a4da-393cb232f466 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
692024-11-22T04:00:14.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3715b581-8ce0-42c2-a4da-393cb232f466 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
702024-11-22T04:00:14.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1987 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3715b581-8ce0-42c2-a4da-393cb232f466 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
712024-11-22T04:00:15.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3740a9da-ad36-47ee-a867-5b6b1f0060b7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
722024-11-22T04:00:15.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3740a9da-ad36-47ee-a867-5b6b1f0060b7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
732024-11-22T04:00:15.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2104 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3740a9da-ad36-47ee-a867-5b6b1f0060b7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
742024-11-22T04:00:16.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7996e2f8-4738-4dee-8de7-8cb293a39fcb roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
752024-11-22T04:00:16.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7996e2f8-4738-4dee-8de7-8cb293a39fcb resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
762024-11-22T04:00:16.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1947 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7996e2f8-4738-4dee-8de7-8cb293a39fcb response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
772024-11-22T04:00:17.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98a0e87c-1acf-4e39-90fd-eb7be9f378cd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
782024-11-22T04:00:17.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98a0e87c-1acf-4e39-90fd-eb7be9f378cd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
792024-11-22T04:00:17.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2442 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98a0e87c-1acf-4e39-90fd-eb7be9f378cd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
802024-11-22T04:00:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
812024-11-22T04:00:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
822024-11-22T04:00:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
832024-11-22T04:00:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
842024-11-22T04:00:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
852024-11-22T04:00:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
862024-11-22T04:00:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
872024-11-22T04:00:18.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
882024-11-22T04:00:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
892024-11-22T04:00:18.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.51592ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
902024-11-22T04:00:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
912024-11-22T04:00:18.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
922024-11-22T04:00:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
932024-11-22T04:00:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
942024-11-22T04:00:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
952024-11-22T04:00:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
962024-11-22T04:00:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
972024-11-22T04:00:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
982024-11-22T04:00:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
992024-11-22T04:00:18.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
1002024-11-22T04:00:18.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.13013ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
1012024-11-22T04:00:19.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 647a9c42-dbc0-407d-8342-9f900eae00f2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1022024-11-22T04:00:19.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 647a9c42-dbc0-407d-8342-9f900eae00f2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1032024-11-22T04:00:19.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1924 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 647a9c42-dbc0-407d-8342-9f900eae00f2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1042024-11-22T04:00:20.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fe8d90db-dc60-4214-a228-5dccf089d1c4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1052024-11-22T04:00:20.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fe8d90db-dc60-4214-a228-5dccf089d1c4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1062024-11-22T04:00:20.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fe8d90db-dc60-4214-a228-5dccf089d1c4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1072024-11-22T04:00:20.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = f8447885-d90a-456f-9799-d18b6f4f65c3 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
1082024-11-22T04:00:21.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a4a8291-7265-4e24-a10d-497bc08c466e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1092024-11-22T04:00:21.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a4a8291-7265-4e24-a10d-497bc08c466e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1102024-11-22T04:00:21.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a4a8291-7265-4e24-a10d-497bc08c466e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1112024-11-22T04:00:22.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c4ec86ee-0d08-48cf-96a5-abc4bb87dd28 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1122024-11-22T04:00:22.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c4ec86ee-0d08-48cf-96a5-abc4bb87dd28 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1132024-11-22T04:00:22.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c4ec86ee-0d08-48cf-96a5-abc4bb87dd28 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1142024-11-22T04:00:23.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f3ad8782-0ab1-4b83-829d-ffd56252af40 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1152024-11-22T04:00:23.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f3ad8782-0ab1-4b83-829d-ffd56252af40 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1162024-11-22T04:00:23.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1830 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f3ad8782-0ab1-4b83-829d-ffd56252af40 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1172024-11-22T04:00:24.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4880e5dc-b020-4dbb-aca7-b80ba8441e71 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1182024-11-22T04:00:24.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4880e5dc-b020-4dbb-aca7-b80ba8441e71 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1192024-11-22T04:00:24.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4880e5dc-b020-4dbb-aca7-b80ba8441e71 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1202024-11-22T04:00:25.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d1284c84-743c-479c-97fd-59099ccaf0aa roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1212024-11-22T04:00:25.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d1284c84-743c-479c-97fd-59099ccaf0aa resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1222024-11-22T04:00:25.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d1284c84-743c-479c-97fd-59099ccaf0aa response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1232024-11-22T04:00:26.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cf090212-2c96-4f69-afe4-4713e7db9d66 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1242024-11-22T04:00:26.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cf090212-2c96-4f69-afe4-4713e7db9d66 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1252024-11-22T04:00:26.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cf090212-2c96-4f69-afe4-4713e7db9d66 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1262024-11-22T04:00:27.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 217e2420-e09e-4d33-999b-3bb50ee94b89 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1272024-11-22T04:00:27.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 217e2420-e09e-4d33-999b-3bb50ee94b89 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1282024-11-22T04:00:27.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 217e2420-e09e-4d33-999b-3bb50ee94b89 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1292024-11-22T04:00:28.201ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49727686-9403-40c5-a8e2-502b20f182dc roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1302024-11-22T04:00:28.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49727686-9403-40c5-a8e2-502b20f182dc resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1312024-11-22T04:00:28.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49727686-9403-40c5-a8e2-502b20f182dc response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
1322024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
1332024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
1342024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
1352024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
1362024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
1372024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1382024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
1392024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
1402024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
1412024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
1422024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
1432024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
1442024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
1452024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
1462024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
1472024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
1482024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
1492024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
1502024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
1512024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
1522024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1532024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
1542024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
1552024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
1562024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
1572024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
1582024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
1592024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
1602024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1612024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
1622024-11-22T04:00:28.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
1632024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
1642024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
1652024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
1662024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
1672024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1682024-11-22T04:00:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
1692024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
1702024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
1712024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
1722024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
1732024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
1742024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
1752024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
1762024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
1772024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
1782024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
1792024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
1802024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
1812024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
1822024-11-22T04:00:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
1832024-11-22T04:00:28.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1842024-11-22T04:00:28.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
1852024-11-22T04:00:28.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
1862024-11-22T04:00:28.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
1872024-11-22T04:00:28.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 794178045 } })
1882024-11-22T04:00:28.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
1892024-11-22T04:00:28.445ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.511703ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
1902024-11-22T04:00:28.447ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 799290405 } })
1912024-11-22T04:00:28.448ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
1922024-11-22T04:00:28.449ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1932024-11-22T04:00:28.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
1942024-11-22T04:00:28.451ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
1952024-11-22T04:00:28.451ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
1962024-11-22T04:00:28.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
1972024-11-22T04:00:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
1982024-11-22T04:00:28.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
1992024-11-22T04:00:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
2002024-11-22T04:00:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2012024-11-22T04:00:28.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2022024-11-22T04:00:28.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
2032024-11-22T04:00:28.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2042024-11-22T04:00:28.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2052024-11-22T04:00:28.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2062024-11-22T04:00:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2072024-11-22T04:00:28.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2082024-11-22T04:00:28.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2092024-11-22T04:00:28.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2102024-11-22T04:00:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2112024-11-22T04:00:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2122024-11-22T04:00:28.459ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1257, tv_nsec: 811416930 } })
2132024-11-22T04:00:28.460ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
2142024-11-22T04:00:28.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2152024-11-22T04:00:28.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2162024-11-22T04:00:28.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2172024-11-22T04:00:28.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2182024-11-22T04:00:28.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2192024-11-22T04:00:28.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
2202024-11-22T04:00:28.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
2212024-11-22T04:00:28.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
2222024-11-22T04:00:28.474ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
2232024-11-22T04:00:28.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
2242024-11-22T04:00:28.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2252024-11-22T04:00:28.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
2262024-11-22T04:00:28.479ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2272024-11-22T04:00:28.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2282024-11-22T04:00:28.482ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2292024-11-22T04:00:28.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2302024-11-22T04:00:28.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.833433ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
2312024-11-22T04:00:28.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 47.112036ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
2322024-11-22T04:00:28.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2332024-11-22T04:00:28.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
2342024-11-22T04:00:28.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
2352024-11-22T04:00:28.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
2362024-11-22T04:00:28.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
2372024-11-22T04:00:28.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
2382024-11-22T04:00:28.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.740213ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
2392024-11-22T04:00:28.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2402024-11-22T04:00:28.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2412024-11-22T04:00:28.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2422024-11-22T04:00:28.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2432024-11-22T04:00:28.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2442024-11-22T04:00:28.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2452024-11-22T04:00:28.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2462024-11-22T04:00:28.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
2472024-11-22T04:00:28.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
2482024-11-22T04:00:28.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
2492024-11-22T04:00:28.500ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2502024-11-22T04:00:28.500ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
2512024-11-22T04:00:28.500ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
2522024-11-22T04:00:28.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2532024-11-22T04:00:28.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
2542024-11-22T04:00:28.501ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 63.71584ms iteration = 12 status = 0
2552024-11-22T04:00:28.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
2562024-11-22T04:00:28.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
2572024-11-22T04:00:28.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
2582024-11-22T04:00:28.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2592024-11-22T04:00:28.502ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
2602024-11-22T04:00:28.502ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.189277ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
2612024-11-22T04:00:28.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2622024-11-22T04:00:28.504ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
2632024-11-22T04:00:28.504ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.617282ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
2642024-11-22T04:00:28.513ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.942948ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
2652024-11-22T04:00:28.524ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
2662024-11-22T04:00:28.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
2672024-11-22T04:00:28.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 94.067879ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
2682024-11-22T04:00:28.546ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
2692024-11-22T04:00:28.546ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
2702024-11-22T04:00:28.546ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 108.883302ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
2712024-11-22T04:00:28.554ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
2722024-11-22T04:00:28.554ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2732024-11-22T04:00:28.554ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc0024b4-01da-40db-994a-a7535ec960c7", "content-length": "26", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
2742024-11-22T04:00:28.554ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2752024-11-22T04:00:28.557ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
2762024-11-22T04:00:28.560ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2772024-11-22T04:00:28.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2782024-11-22T04:00:28.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 128.348347ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
2792024-11-22T04:00:28.599ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 161.867512ms iteration = 14 status = {"physical_disks_added":0}
2802024-11-22T04:00:28.603ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
2812024-11-22T04:00:28.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
2822024-11-22T04:00:28.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2832024-11-22T04:00:28.619ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2842024-11-22T04:00:28.619ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b534161-412c-494a-b40f-ffbc95f165e2", "content-length": "26", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
2852024-11-22T04:00:28.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2862024-11-22T04:00:28.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2872024-11-22T04:00:28.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
2882024-11-22T04:00:28.627ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
2892024-11-22T04:00:28.628ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0cbb3c4-9463-4f32-8cc5-b45c3644d100", "content-length": "26", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
2902024-11-22T04:00:28.628ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
2912024-11-22T04:00:28.629ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
2922024-11-22T04:00:28.680ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
2932024-11-22T04:00:28.680ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
2942024-11-22T04:00:28.681ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bab5ba77-6f31-40a4-a266-cf40d52ed5af", "content-length": "372", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
2952024-11-22T04:00:28.682ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
2962024-11-22T04:00:28.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
2972024-11-22T04:00:28.685ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
2982024-11-22T04:00:28.687ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
2992024-11-22T04:00:28.687ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3002024-11-22T04:00:28.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3012024-11-22T04:00:28.690ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
3022024-11-22T04:00:28.692ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
3032024-11-22T04:00:28.692ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
3042024-11-22T04:00:28.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
3052024-11-22T04:00:28.706ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
3062024-11-22T04:00:28.706ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
3072024-11-22T04:00:28.706ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fa27d49b-1677-45eb-b719-9331327cb062", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3082024-11-22T04:00:28.706ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3092024-11-22T04:00:28.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3102024-11-22T04:00:28.708ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3112024-11-22T04:00:28.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3122024-11-22T04:00:28.710ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
3132024-11-22T04:00:28.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
3142024-11-22T04:00:28.713ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
3152024-11-22T04:00:28.713ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
3162024-11-22T04:00:28.713ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "212452be-dc49-452d-b64c-c048e8eec8af", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3172024-11-22T04:00:28.715ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 277.541055ms iteration = 12 status = {}
3182024-11-22T04:00:28.725ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 288.263485ms iteration = 12 status = {}
3192024-11-22T04:00:28.792ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
3202024-11-22T04:00:28.792ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e280b0ee-cf4b-44ec-9101-af85fa30a441", "content-length": "691", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3212024-11-22T04:00:28.792ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
3222024-11-22T04:00:28.792ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
3232024-11-22T04:00:28.792ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
3242024-11-22T04:00:28.794ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 356.698608ms iteration = 12 status = {}
3252024-11-22T04:00:28.826ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
3262024-11-22T04:00:28.826ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e75a37d-9825-4860-b566-76481f9e8919", "content-length": "1", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3272024-11-22T04:00:28.827ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
3282024-11-22T04:00:28.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
3292024-11-22T04:00:28.830ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 392.750569ms iteration = 12 status = null
3302024-11-22T04:00:28.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3312024-11-22T04:00:28.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3322024-11-22T04:00:28.864ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
3332024-11-22T04:00:28.864ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3342024-11-22T04:00:28.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3352024-11-22T04:00:28.874ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
3362024-11-22T04:00:28.874ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cf498e2-66c7-4675-a422-a77d34dd85d9", "content-length": "134", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3372024-11-22T04:00:28.874ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
3382024-11-22T04:00:28.874ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
3392024-11-22T04:00:28.874ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
3402024-11-22T04:00:28.874ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
3412024-11-22T04:00:28.875ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3422024-11-22T04:00:28.875ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3432024-11-22T04:00:28.875ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3442024-11-22T04:00:28.875ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3452024-11-22T04:00:28.875ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
3462024-11-22T04:00:28.875ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
3472024-11-22T04:00:28.875ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
3482024-11-22T04:00:28.875ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3492024-11-22T04:00:28.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3502024-11-22T04:00:28.878ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
3512024-11-22T04:00:28.878ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d35cabd-9045-4101-af6a-d37fbd5e1793", "content-length": "2", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3522024-11-22T04:00:28.878ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
3532024-11-22T04:00:28.878ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2e2b663-4f6e-4312-a475-7b4c4cf6d4bc", "content-length": "52", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3542024-11-22T04:00:28.878ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
3552024-11-22T04:00:28.878ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
3562024-11-22T04:00:28.971ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f5a7bcbf-dc5b-4fc4-9317-7cd21703afcf", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3572024-11-22T04:00:28.972ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
3582024-11-22T04:00:28.972ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
3592024-11-22T04:00:28.972ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "41d6f5d5-55c5-4fba-a92c-58ce65bd5a04", "content-length": "682", "date": "Fri, 22 Nov 2024 04:00:28 GMT"} })
3602024-11-22T04:00:28.972ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3612024-11-22T04:00:28.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3622024-11-22T04:00:28.976ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3632024-11-22T04:00:28.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3642024-11-22T04:00:28.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3652024-11-22T04:00:28.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3662024-11-22T04:00:28.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
3672024-11-22T04:00:28.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
3682024-11-22T04:00:28.993ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 555.741961ms iteration = 12 status = {}
3692024-11-22T04:00:29.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = d513d338-66b9-4f43-a312-f165e439e4a6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
3702024-11-22T04:00:29.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = d513d338-66b9-4f43-a312-f165e439e4a6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
3712024-11-22T04:00:29.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = d513d338-66b9-4f43-a312-f165e439e4a6 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
3722024-11-22T04:00:29.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68a6da23-4bb1-4969-b8b5-1f0d71b2996f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3732024-11-22T04:00:29.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68a6da23-4bb1-4969-b8b5-1f0d71b2996f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3742024-11-22T04:00:29.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68a6da23-4bb1-4969-b8b5-1f0d71b2996f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3752024-11-22T04:00:30.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f79bd46-6720-4d0d-86d7-790253b6fc8d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3762024-11-22T04:00:30.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f79bd46-6720-4d0d-86d7-790253b6fc8d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3772024-11-22T04:00:30.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2190 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f79bd46-6720-4d0d-86d7-790253b6fc8d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3782024-11-22T04:00:30.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 580 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 1854cd8f-1ccb-4527-8d2d-63c04bbdba5e response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
3792024-11-22T04:00:31.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e5fccefe-6376-4749-8c99-6ba4084aa7b5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3802024-11-22T04:00:31.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e5fccefe-6376-4749-8c99-6ba4084aa7b5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3812024-11-22T04:00:31.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1734 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e5fccefe-6376-4749-8c99-6ba4084aa7b5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3822024-11-22T04:00:32.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2552c1ac-fbaa-4a5c-80da-c3118f6459d1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3832024-11-22T04:00:32.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2552c1ac-fbaa-4a5c-80da-c3118f6459d1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3842024-11-22T04:00:32.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2376 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2552c1ac-fbaa-4a5c-80da-c3118f6459d1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3852024-11-22T04:00:33.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5ead58ed-12be-400b-9f06-5eea8efbac79 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3862024-11-22T04:00:33.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5ead58ed-12be-400b-9f06-5eea8efbac79 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3872024-11-22T04:00:33.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5ead58ed-12be-400b-9f06-5eea8efbac79 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3882024-11-22T04:00:34.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 31b5a21a-43cc-4832-9e21-7848a9535820 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3892024-11-22T04:00:34.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 31b5a21a-43cc-4832-9e21-7848a9535820 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3902024-11-22T04:00:34.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2323 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 31b5a21a-43cc-4832-9e21-7848a9535820 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3912024-11-22T04:00:35.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3bf5987-6570-42d2-bba9-97752f37624c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3922024-11-22T04:00:35.349ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3bf5987-6570-42d2-bba9-97752f37624c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3932024-11-22T04:00:35.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3bf5987-6570-42d2-bba9-97752f37624c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3942024-11-22T04:00:36.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eb387d89-371f-4b58-aa7c-352cc39c8ed6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3952024-11-22T04:00:36.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eb387d89-371f-4b58-aa7c-352cc39c8ed6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3962024-11-22T04:00:36.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eb387d89-371f-4b58-aa7c-352cc39c8ed6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3972024-11-22T04:00:37.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df2de827-8f16-46eb-8dd8-84d41a33595d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3982024-11-22T04:00:37.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df2de827-8f16-46eb-8dd8-84d41a33595d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
3992024-11-22T04:00:37.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2697 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df2de827-8f16-46eb-8dd8-84d41a33595d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4002024-11-22T04:00:38.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f20baed6-f3bf-4816-9cae-0e358fb35e9f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4012024-11-22T04:00:38.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f20baed6-f3bf-4816-9cae-0e358fb35e9f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4022024-11-22T04:00:38.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f20baed6-f3bf-4816-9cae-0e358fb35e9f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4032024-11-22T04:00:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
4042024-11-22T04:00:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
4052024-11-22T04:00:38.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4062024-11-22T04:00:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4072024-11-22T04:00:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4082024-11-22T04:00:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4092024-11-22T04:00:38.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4102024-11-22T04:00:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4112024-11-22T04:00:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4122024-11-22T04:00:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.016234ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4132024-11-22T04:00:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4142024-11-22T04:00:38.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4152024-11-22T04:00:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4162024-11-22T04:00:38.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4172024-11-22T04:00:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4182024-11-22T04:00:38.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4192024-11-22T04:00:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
4202024-11-22T04:00:38.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4212024-11-22T04:00:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4222024-11-22T04:00:38.455ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
4232024-11-22T04:00:38.455ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.790286ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
4242024-11-22T04:00:39.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b3e7147-6774-4f71-bfa1-6f661ba2a2da roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4252024-11-22T04:00:39.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b3e7147-6774-4f71-bfa1-6f661ba2a2da resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4262024-11-22T04:00:39.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b3e7147-6774-4f71-bfa1-6f661ba2a2da response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4272024-11-22T04:00:40.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6bb30a7d-f331-4ecf-ab5d-75a2afe0fcae roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4282024-11-22T04:00:40.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6bb30a7d-f331-4ecf-ab5d-75a2afe0fcae resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4292024-11-22T04:00:40.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6bb30a7d-f331-4ecf-ab5d-75a2afe0fcae response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4302024-11-22T04:00:40.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = af174eda-2880-4b8f-aa30-ce2f5cfc7f57 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
4312024-11-22T04:00:40.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = af174eda-2880-4b8f-aa30-ce2f5cfc7f57 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
4322024-11-22T04:00:40.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = af174eda-2880-4b8f-aa30-ce2f5cfc7f57 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
4332024-11-22T04:00:40.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = b92fc913-b4ba-4034-a4a0-2666761fefd6 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
4342024-11-22T04:00:40.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = b92fc913-b4ba-4034-a4a0-2666761fefd6 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
4352024-11-22T04:00:40.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2726 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = b92fc913-b4ba-4034-a4a0-2666761fefd6 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
4362024-11-22T04:00:40.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 554 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 1b938915-97c7-4d57-a6c7-d97b30731ef0 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
4372024-11-22T04:00:41.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 15471fbe-2d23-48f5-bd6c-fbe741f4c0b4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4382024-11-22T04:00:41.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 15471fbe-2d23-48f5-bd6c-fbe741f4c0b4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4392024-11-22T04:00:41.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 15471fbe-2d23-48f5-bd6c-fbe741f4c0b4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4402024-11-22T04:00:42.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f64b896d-1684-4296-aa7e-12dcdab830a5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4412024-11-22T04:00:42.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f64b896d-1684-4296-aa7e-12dcdab830a5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4422024-11-22T04:00:42.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2297 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f64b896d-1684-4296-aa7e-12dcdab830a5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4432024-11-22T04:00:43.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9d355019-40bd-43ce-b4b6-48c09e5fed1f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4442024-11-22T04:00:43.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9d355019-40bd-43ce-b4b6-48c09e5fed1f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4452024-11-22T04:00:43.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1715 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9d355019-40bd-43ce-b4b6-48c09e5fed1f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4462024-11-22T04:00:44.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 36843aaf-007d-4453-8b9c-741b30142a93 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4472024-11-22T04:00:44.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 36843aaf-007d-4453-8b9c-741b30142a93 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4482024-11-22T04:00:44.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 36843aaf-007d-4453-8b9c-741b30142a93 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4492024-11-22T04:00:45.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 467c3ab0-df0e-4005-bb2e-ca2022e26723 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4502024-11-22T04:00:45.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 467c3ab0-df0e-4005-bb2e-ca2022e26723 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4512024-11-22T04:00:45.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 467c3ab0-df0e-4005-bb2e-ca2022e26723 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4522024-11-22T04:00:46.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9b649ea8-101e-4202-87a3-d29820ee3ccc roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4532024-11-22T04:00:46.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9b649ea8-101e-4202-87a3-d29820ee3ccc resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4542024-11-22T04:00:46.585ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9b649ea8-101e-4202-87a3-d29820ee3ccc response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4552024-11-22T04:00:47.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ce428663-47bd-4764-b6f6-8a9f3206bd12 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4562024-11-22T04:00:47.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ce428663-47bd-4764-b6f6-8a9f3206bd12 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4572024-11-22T04:00:47.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ce428663-47bd-4764-b6f6-8a9f3206bd12 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4582024-11-22T04:00:48.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
4592024-11-22T04:00:48.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
4602024-11-22T04:00:48.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4612024-11-22T04:00:48.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4622024-11-22T04:00:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4632024-11-22T04:00:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4642024-11-22T04:00:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4652024-11-22T04:00:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
4662024-11-22T04:00:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4672024-11-22T04:00:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4682024-11-22T04:00:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4692024-11-22T04:00:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4702024-11-22T04:00:48.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4712024-11-22T04:00:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
4722024-11-22T04:00:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4732024-11-22T04:00:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4742024-11-22T04:00:48.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
4752024-11-22T04:00:48.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.372185ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
4762024-11-22T04:00:48.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4772024-11-22T04:00:48.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4782024-11-22T04:00:48.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.030831ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
4792024-11-22T04:00:48.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 110d3787-68b4-4e63-aaf8-5816ba3c7c93 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4802024-11-22T04:00:48.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 110d3787-68b4-4e63-aaf8-5816ba3c7c93 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4812024-11-22T04:00:48.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 110d3787-68b4-4e63-aaf8-5816ba3c7c93 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4822024-11-22T04:00:49.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 156a5ee4-48d1-4857-8361-1ed5d12c880f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4832024-11-22T04:00:49.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 156a5ee4-48d1-4857-8361-1ed5d12c880f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4842024-11-22T04:00:49.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2329 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 156a5ee4-48d1-4857-8361-1ed5d12c880f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4852024-11-22T04:00:50.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 869 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 1ee6ce09-e37b-4755-9ab5-1b81c7851e8b response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
4862024-11-22T04:00:50.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68d73b59-72c3-4185-80f4-258a00a7094d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4872024-11-22T04:00:50.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68d73b59-72c3-4185-80f4-258a00a7094d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4882024-11-22T04:00:50.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2293 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68d73b59-72c3-4185-80f4-258a00a7094d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4892024-11-22T04:00:51.690ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6379491d-7828-41d5-ae30-22ee8ab3f691 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4902024-11-22T04:00:51.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6379491d-7828-41d5-ae30-22ee8ab3f691 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4912024-11-22T04:00:51.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1963 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6379491d-7828-41d5-ae30-22ee8ab3f691 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4922024-11-22T04:00:52.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a99a8e9-5b0d-418a-baad-edf481393f07 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4932024-11-22T04:00:52.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a99a8e9-5b0d-418a-baad-edf481393f07 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4942024-11-22T04:00:52.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2102 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a99a8e9-5b0d-418a-baad-edf481393f07 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4952024-11-22T04:00:53.730ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c8a1631a-9a39-468c-8f60-55475475bf43 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4962024-11-22T04:00:53.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c8a1631a-9a39-468c-8f60-55475475bf43 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4972024-11-22T04:00:53.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2142 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c8a1631a-9a39-468c-8f60-55475475bf43 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4982024-11-22T04:00:54.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c43ac611-68d8-4f66-a938-6dd9663980ed roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
4992024-11-22T04:00:54.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c43ac611-68d8-4f66-a938-6dd9663980ed resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5002024-11-22T04:00:54.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c43ac611-68d8-4f66-a938-6dd9663980ed response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5012024-11-22T04:00:55.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cc5a07fc-2f75-4f50-b7a0-f4ae955abf8a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5022024-11-22T04:00:55.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cc5a07fc-2f75-4f50-b7a0-f4ae955abf8a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5032024-11-22T04:00:55.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2316 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cc5a07fc-2f75-4f50-b7a0-f4ae955abf8a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5042024-11-22T04:00:56.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 796bb210-f0be-498e-a373-50f6572e3ca4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5052024-11-22T04:00:56.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 796bb210-f0be-498e-a373-50f6572e3ca4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5062024-11-22T04:00:56.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2381 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 796bb210-f0be-498e-a373-50f6572e3ca4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5072024-11-22T04:00:57.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9dd869b4-09f2-4cd3-ad2e-309bcaa345c8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5082024-11-22T04:00:57.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9dd869b4-09f2-4cd3-ad2e-309bcaa345c8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5092024-11-22T04:00:57.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9dd869b4-09f2-4cd3-ad2e-309bcaa345c8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
5102024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
5112024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
5122024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5132024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
5142024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
5152024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
5162024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
5172024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5182024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
5192024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
5202024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
5212024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5222024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5232024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
5242024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
5252024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
5262024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
5272024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
5282024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5292024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
5302024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
5312024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
5322024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
5332024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5342024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
5352024-11-22T04:00:58.437ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:50:58.437449769 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
5362024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5372024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5382024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
5392024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
5402024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5412024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
5422024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
5432024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5442024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
5452024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
5462024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
5472024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
5482024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5492024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
5502024-11-22T04:00:58.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
5512024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
5522024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5532024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5542024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
5552024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5562024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
5572024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5582024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5592024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
5602024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
5612024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5622024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5632024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
5642024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
5652024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
5662024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
5672024-11-22T04:00:58.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
5682024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5692024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
5702024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5712024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 8.12\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
5722024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5732024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
5742024-11-22T04:00:58.437ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
5752024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
5762024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5772024-11-22T04:00:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5782024-11-22T04:00:58.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 789379600 } })
5792024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5802024-11-22T04:00:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 789552323 } })
5812024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5822024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5832024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5842024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5852024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5862024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5872024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5882024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5892024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
5902024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5912024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
5922024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5932024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5942024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5952024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5962024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5972024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5982024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5992024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6002024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6012024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6022024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6032024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6042024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
6052024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
6062024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.241771ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
6072024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6082024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6092024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
6102024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 851.725\u{b5}s iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
6112024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
6122024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6132024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6142024-11-22T04:00:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6152024-11-22T04:00:58.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.888779ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
6162024-11-22T04:00:58.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 792757159 } })
6172024-11-22T04:00:58.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.801868ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
6182024-11-22T04:00:58.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
6192024-11-22T04:00:58.441ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
6202024-11-22T04:00:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
6212024-11-22T04:00:58.441ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6222024-11-22T04:00:58.444ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6232024-11-22T04:00:58.444ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6242024-11-22T04:00:58.444ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 6.849491ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6252024-11-22T04:00:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6262024-11-22T04:00:58.444ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6272024-11-22T04:00:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6282024-11-22T04:00:58.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6292024-11-22T04:00:58.447ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:50:58.437449769 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
6302024-11-22T04:00:58.447ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.883156ms iteration = 7 status = {"expiration":"2024-11-22T03:50:58.437449769Z","pruned":[]}
6312024-11-22T04:00:58.447ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322024-11-22T04:00:58.447ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.236991ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
6332024-11-22T04:00:58.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
6342024-11-22T04:00:58.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6352024-11-22T04:00:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6362024-11-22T04:00:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6372024-11-22T04:00:58.449ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6382024-11-22T04:00:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6392024-11-22T04:00:58.449ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6402024-11-22T04:00:58.450ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1287, tv_nsec: 801823520 } })
6412024-11-22T04:00:58.450ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
6422024-11-22T04:00:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
6432024-11-22T04:00:58.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6442024-11-22T04:00:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6452024-11-22T04:00:58.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462024-11-22T04:00:58.452ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6472024-11-22T04:00:58.454ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6482024-11-22T04:00:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6492024-11-22T04:00:58.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6502024-11-22T04:00:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6512024-11-22T04:00:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
6522024-11-22T04:00:58.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6532024-11-22T04:00:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6542024-11-22T04:00:58.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6552024-11-22T04:00:58.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6562024-11-22T04:00:58.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6572024-11-22T04:00:58.457ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6582024-11-22T04:00:58.458ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6592024-11-22T04:00:58.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6602024-11-22T04:00:58.460ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6612024-11-22T04:00:58.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6622024-11-22T04:00:58.461ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6632024-11-22T04:00:58.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6642024-11-22T04:00:58.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6652024-11-22T04:00:58.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6662024-11-22T04:00:58.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
6672024-11-22T04:00:58.465ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6682024-11-22T04:00:58.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6692024-11-22T04:00:58.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
6702024-11-22T04:00:58.468ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
6712024-11-22T04:00:58.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
6722024-11-22T04:00:58.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6732024-11-22T04:00:58.473ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6742024-11-22T04:00:58.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6752024-11-22T04:00:58.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6762024-11-22T04:00:58.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6772024-11-22T04:00:58.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6782024-11-22T04:00:58.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
6792024-11-22T04:00:58.475ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6802024-11-22T04:00:58.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6812024-11-22T04:00:58.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
6822024-11-22T04:00:58.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6832024-11-22T04:00:58.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6842024-11-22T04:00:58.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6852024-11-22T04:00:58.479ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6862024-11-22T04:00:58.480ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6872024-11-22T04:00:58.482ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6882024-11-22T04:00:58.482ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6892024-11-22T04:00:58.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6902024-11-22T04:00:58.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6912024-11-22T04:00:58.483ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6922024-11-22T04:00:58.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6932024-11-22T04:00:58.483ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.16326ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
6942024-11-22T04:00:58.484ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6952024-11-22T04:00:58.485ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6962024-11-22T04:00:58.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
6972024-11-22T04:00:58.486ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
6982024-11-22T04:00:58.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
6992024-11-22T04:00:58.486ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7002024-11-22T04:00:58.486ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
7012024-11-22T04:00:58.486ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7022024-11-22T04:00:58.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7032024-11-22T04:00:58.487ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
7042024-11-22T04:00:58.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
7052024-11-22T04:00:58.489ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
7062024-11-22T04:00:58.489ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
7072024-11-22T04:00:58.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
7082024-11-22T04:00:58.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7092024-11-22T04:00:58.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.718337ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
7102024-11-22T04:00:58.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
7112024-11-22T04:00:58.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
7122024-11-22T04:00:58.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
7132024-11-22T04:00:58.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
7142024-11-22T04:00:58.502ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
7152024-11-22T04:00:58.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
7162024-11-22T04:00:58.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
7172024-11-22T04:00:58.509ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
7182024-11-22T04:00:58.509ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 71.475918ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
7192024-11-22T04:00:58.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7202024-11-22T04:00:58.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7212024-11-22T04:00:58.511ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7222024-11-22T04:00:58.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7232024-11-22T04:00:58.517ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
7242024-11-22T04:00:58.517ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
7252024-11-22T04:00:58.517ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
7262024-11-22T04:00:58.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7272024-11-22T04:00:58.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7282024-11-22T04:00:58.518ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292024-11-22T04:00:58.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
7302024-11-22T04:00:58.520ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
7312024-11-22T04:00:58.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7322024-11-22T04:00:58.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
7332024-11-22T04:00:58.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7342024-11-22T04:00:58.524ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
7352024-11-22T04:00:58.524ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
7362024-11-22T04:00:58.524ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
7372024-11-22T04:00:58.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
7382024-11-22T04:00:58.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
7392024-11-22T04:00:58.527ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7402024-11-22T04:00:58.527ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.792503ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7412024-11-22T04:00:58.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
7422024-11-22T04:00:58.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
7432024-11-22T04:00:58.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7442024-11-22T04:00:58.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7452024-11-22T04:00:58.542ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7462024-11-22T04:00:58.542ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7472024-11-22T04:00:58.542ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 104.705788ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7482024-11-22T04:00:58.544ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7492024-11-22T04:00:58.544ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
7502024-11-22T04:00:58.544ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
7512024-11-22T04:00:58.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
7522024-11-22T04:00:58.567ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
7532024-11-22T04:00:58.578ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
7542024-11-22T04:00:58.585ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7552024-11-22T04:00:58.585ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7562024-11-22T04:00:58.585ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b94d0857-28fb-42c2-859a-356a64b6bb43", "content-length": "26", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
7572024-11-22T04:00:58.585ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7582024-11-22T04:00:58.586ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7592024-11-22T04:00:58.596ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 158.529483ms iteration = 15 status = {"physical_disks_added":0}
7602024-11-22T04:00:58.600ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
7612024-11-22T04:00:58.600ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
7622024-11-22T04:00:58.600ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d0cef464-0fe3-4385-95de-c608f9265365", "content-length": "26", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
7632024-11-22T04:00:58.600ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
7642024-11-22T04:00:58.603ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
7652024-11-22T04:00:58.650ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
7662024-11-22T04:00:58.651ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
7672024-11-22T04:00:58.651ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "72cde1d3-d987-4010-95d3-acd156f1cee7", "content-length": "372", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
7682024-11-22T04:00:58.651ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
7692024-11-22T04:00:58.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
7702024-11-22T04:00:58.654ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1288, tv_nsec: 6337829 } })
7712024-11-22T04:00:58.655ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
7722024-11-22T04:00:58.658ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 220.755567ms iteration = 4 status = {"nsuccess":5}
7732024-11-22T04:00:58.659ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7742024-11-22T04:00:58.660ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7752024-11-22T04:00:58.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7762024-11-22T04:00:58.668ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7772024-11-22T04:00:58.668ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 230.913967ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7782024-11-22T04:00:58.668ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792024-11-22T04:00:58.669ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
7802024-11-22T04:00:58.669ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7812024-11-22T04:00:58.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
7822024-11-22T04:00:58.671ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
7832024-11-22T04:00:58.671ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
7842024-11-22T04:00:58.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
7852024-11-22T04:00:58.679ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7862024-11-22T04:00:58.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7872024-11-22T04:00:58.696ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
7882024-11-22T04:00:58.711ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
7892024-11-22T04:00:58.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7902024-11-22T04:00:58.725ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 288.235694ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
7912024-11-22T04:00:58.726ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 288.582131ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7922024-11-22T04:00:58.727ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7932024-11-22T04:00:58.727ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7942024-11-22T04:00:58.727ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 290.078367ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7952024-11-22T04:00:58.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7962024-11-22T04:00:58.735ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
7972024-11-22T04:00:58.735ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
7982024-11-22T04:00:58.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
7992024-11-22T04:00:58.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8002024-11-22T04:00:58.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8012024-11-22T04:00:58.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8022024-11-22T04:00:58.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
8032024-11-22T04:00:58.738ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
8042024-11-22T04:00:58.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
8052024-11-22T04:00:58.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8062024-11-22T04:00:58.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8072024-11-22T04:00:58.741ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8082024-11-22T04:00:58.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8092024-11-22T04:00:58.741ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 304.225479ms iteration = 13 status = 0
8102024-11-22T04:00:58.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
8112024-11-22T04:00:58.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
8122024-11-22T04:00:58.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
8132024-11-22T04:00:58.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8142024-11-22T04:00:58.743ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8152024-11-22T04:00:58.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8162024-11-22T04:00:58.744ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
8172024-11-22T04:00:58.744ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
8182024-11-22T04:00:58.744ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "53522456-2e4d-4a03-a6e4-60b40d9dc8f0", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
8192024-11-22T04:00:58.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8202024-11-22T04:00:58.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8212024-11-22T04:00:58.745ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) }
8222024-11-22T04:00:58.745ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 307.835083ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
8232024-11-22T04:00:58.745ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
8242024-11-22T04:00:58.745ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
8252024-11-22T04:00:58.745ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
8262024-11-22T04:00:58.745ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 308.633776ms iteration = 7 status = {"generation":1}
8272024-11-22T04:00:58.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8282024-11-22T04:00:58.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8292024-11-22T04:00:58.757ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
8302024-11-22T04:00:58.757ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5d56d636-26e9-4419-aac1-d358582dd7de", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
8312024-11-22T04:00:58.757ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
8322024-11-22T04:00:58.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
8332024-11-22T04:00:58.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
8342024-11-22T04:00:58.759ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bc089c99-250b-43eb-8662-883757c7b320", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
8352024-11-22T04:00:58.759ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
8362024-11-22T04:00:58.760ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 323.259616ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
8372024-11-22T04:00:58.762ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 324.783602ms iteration = 13 status = {}
8382024-11-22T04:00:58.762ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
8392024-11-22T04:00:58.762ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 325.128799ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
8402024-11-22T04:00:58.762ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
8412024-11-22T04:00:58.762ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
8422024-11-22T04:00:58.763ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "14aa24b4-aeac-4996-9614-ac3d80aea379", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
8432024-11-22T04:00:58.765ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 327.758825ms iteration = 13 status = {}
8442024-11-22T04:00:58.767ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
8452024-11-22T04:00:58.767ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ecd6798-e08e-4f64-998e-aa5d6fb41923", "content-length": "1", "date": "Fri, 22 Nov 2024 04:00:57 GMT"} })
8462024-11-22T04:00:58.769ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
8472024-11-22T04:00:58.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
8482024-11-22T04:00:58.774ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 337.080301ms iteration = 13 status = null
8492024-11-22T04:00:58.788ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
8502024-11-22T04:00:58.788ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
8512024-11-22T04:00:58.788ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8522024-11-22T04:00:58.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8532024-11-22T04:00:58.790ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8542024-11-22T04:00:58.794ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
8552024-11-22T04:00:58.794ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
8562024-11-22T04:00:58.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
8572024-11-22T04:00:58.794ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
8582024-11-22T04:00:58.794ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
8592024-11-22T04:00:58.794ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
8602024-11-22T04:00:58.794ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "26fe97d8-bf80-436f-ad01-5d0d51d06121", "content-length": "26", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
8612024-11-22T04:00:58.794ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
8622024-11-22T04:00:58.795ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "63af1ff9-71ba-47fd-96e0-a019c3590bdb", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
8632024-11-22T04:00:58.795ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
8642024-11-22T04:00:58.795ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8652024-11-22T04:00:58.796ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
8662024-11-22T04:00:58.796ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
8672024-11-22T04:00:58.796ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
8682024-11-22T04:00:58.796ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 358.852456ms iteration = 7 status = {"generation":2}
8692024-11-22T04:00:58.797ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
8702024-11-22T04:00:58.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8712024-11-22T04:00:58.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8722024-11-22T04:00:58.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8732024-11-22T04:00:58.803ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f5826229-55a3-420d-9a70-f2b238d2001a", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
8742024-11-22T04:00:58.803ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
8752024-11-22T04:00:58.804ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "60dc5682-5177-480c-8819-b245613908d9", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
8762024-11-22T04:00:58.805ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
8772024-11-22T04:00:58.807ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
8782024-11-22T04:00:58.807ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 369.829002ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
8792024-11-22T04:00:58.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 931f79c1-3b1e-42b0-a891-d52ce6a16419 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
8802024-11-22T04:00:58.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 931f79c1-3b1e-42b0-a891-d52ce6a16419 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
8812024-11-22T04:00:58.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6593 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 931f79c1-3b1e-42b0-a891-d52ce6a16419 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
8822024-11-22T04:00:58.906ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8832024-11-22T04:00:58.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8842024-11-22T04:00:58.907ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
8852024-11-22T04:00:58.908ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
8862024-11-22T04:00:58.908ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
8872024-11-22T04:00:58.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
8882024-11-22T04:00:58.918ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
8892024-11-22T04:00:58.919ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e751a221-9708-4e54-ad52-426fc7fe2af2", "content-length": "134", "date": "Fri, 22 Nov 2024 04:00:57 GMT"} })
8902024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
8912024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
8922024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
8932024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
8942024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8952024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8962024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8972024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
8982024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
8992024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
9002024-11-22T04:00:58.919ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
9012024-11-22T04:00:58.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9022024-11-22T04:00:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9032024-11-22T04:00:58.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
9042024-11-22T04:00:58.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "abab0add-9302-4302-80ee-bf9ee1196660", "content-length": "2", "date": "Fri, 22 Nov 2024 04:00:57 GMT"} })
9052024-11-22T04:00:58.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
9062024-11-22T04:00:58.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "54b32d68-6e6b-4543-86c9-d06c1c5c4a4b", "content-length": "52", "date": "Fri, 22 Nov 2024 04:00:57 GMT"} })
9072024-11-22T04:00:58.922ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
9082024-11-22T04:00:58.922ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
9092024-11-22T04:00:58.975ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f0fe2f4-ed8f-4456-ab3a-a5aec13e1e60", "content-length": "691", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
9102024-11-22T04:00:58.976ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
9112024-11-22T04:00:58.976ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
9122024-11-22T04:00:58.976ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
9132024-11-22T04:00:58.977ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 539.848369ms iteration = 13 status = {}
9142024-11-22T04:00:59.079ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a41dae2b-d032-4af6-8e3f-ef681ac52796", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
9152024-11-22T04:00:59.079ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
9162024-11-22T04:00:59.079ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
9172024-11-22T04:00:59.083ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "436a5ccb-0523-4d9f-bac6-98ea3bad748c", "content-length": "682", "date": "Fri, 22 Nov 2024 04:00:58 GMT"} })
9182024-11-22T04:00:59.083ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9192024-11-22T04:00:59.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9202024-11-22T04:00:59.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9212024-11-22T04:00:59.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9222024-11-22T04:00:59.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9232024-11-22T04:00:59.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9242024-11-22T04:00:59.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
9252024-11-22T04:00:59.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
9262024-11-22T04:00:59.100ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 662.417213ms iteration = 13 status = {}
9272024-11-22T04:00:59.110ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
9282024-11-22T04:00:59.110ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
9292024-11-22T04:00:59.141ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
9302024-11-22T04:00:59.141ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:60424
9312024-11-22T04:00:59.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60424 req_id = 88d87207-bd3d-4ea1-899b-a2cf847c790b roles = RoleSet { roles: {} } uri = /metrics/producers
9322024-11-22T04:00:59.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60424 req_id = 88d87207-bd3d-4ea1-899b-a2cf847c790b resource = Database result = Ok(()) uri = /metrics/producers
9332024-11-22T04:00:59.183ZINFOnexus: assigned collector to new producer collector_id = 619dee3a-9d47-45ec-a665-d347c721dbd7 file = nexus/src/app/oximeter.rs:76 producer_id = 8af2b85f-6ab3-4781-9033-075825f48255
9342024-11-22T04:00:59.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42414 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60424 req_id = 88d87207-bd3d-4ea1-899b-a2cf847c790b response_code = 201 uri = /metrics/producers
9352024-11-22T04:00:59.183ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "88d87207-bd3d-4ea1-899b-a2cf847c790b", "content-length": "41", "date": "Fri, 22 Nov 2024 04:00:59 GMT"} })
9362024-11-22T04:00:59.185ZDEBGnexus (producer-registration-task): registered with nexus successfully
9372024-11-22T04:00:59.185ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
9382024-11-22T04:00:59.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = eca26cd9-4aa8-4481-946f-1dcff791c769 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
9392024-11-22T04:00:59.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = eca26cd9-4aa8-4481-946f-1dcff791c769 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
9402024-11-22T04:00:59.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = eca26cd9-4aa8-4481-946f-1dcff791c769 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
9412024-11-22T04:00:59.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bf8c7d8f-e858-4fb4-ac8f-b2712b7e6d4f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9422024-11-22T04:00:59.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bf8c7d8f-e858-4fb4-ac8f-b2712b7e6d4f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9432024-11-22T04:00:59.869ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2124 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bf8c7d8f-e858-4fb4-ac8f-b2712b7e6d4f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9442024-11-22T04:01:00.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 478 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 8edfd818-6eb0-422c-825a-0971233a4451 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
9452024-11-22T04:01:00.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cdd93a4d-a063-4a10-a413-11d152173587 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9462024-11-22T04:01:00.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cdd93a4d-a063-4a10-a413-11d152173587 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9472024-11-22T04:01:00.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2358 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cdd93a4d-a063-4a10-a413-11d152173587 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9482024-11-22T04:01:01.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 945c6220-a25c-4839-9ede-0cf90703eccc roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9492024-11-22T04:01:01.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 945c6220-a25c-4839-9ede-0cf90703eccc resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9502024-11-22T04:01:01.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 945c6220-a25c-4839-9ede-0cf90703eccc response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9512024-11-22T04:01:02.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ce405885-6de5-41b1-bef4-58aa6bef3bca roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9522024-11-22T04:01:02.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ce405885-6de5-41b1-bef4-58aa6bef3bca resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9532024-11-22T04:01:02.935ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2392 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ce405885-6de5-41b1-bef4-58aa6bef3bca response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9542024-11-22T04:01:03.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e9d54f4-5272-48ce-8f04-c6b310785d65 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9552024-11-22T04:01:03.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e9d54f4-5272-48ce-8f04-c6b310785d65 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9562024-11-22T04:01:03.956ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2189 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e9d54f4-5272-48ce-8f04-c6b310785d65 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9572024-11-22T04:01:04.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 395d7050-04d9-49bc-b8df-1b973079e6f5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9582024-11-22T04:01:04.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 395d7050-04d9-49bc-b8df-1b973079e6f5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9592024-11-22T04:01:04.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 395d7050-04d9-49bc-b8df-1b973079e6f5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9602024-11-22T04:01:05.998ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b5d249a-98d0-414a-925a-dead13bafbc1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9612024-11-22T04:01:05.998ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b5d249a-98d0-414a-925a-dead13bafbc1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9622024-11-22T04:01:06.000ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2267 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b5d249a-98d0-414a-925a-dead13bafbc1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9632024-11-22T04:01:07.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d212fee5-6fba-4b03-aba9-10764debad44 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9642024-11-22T04:01:07.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d212fee5-6fba-4b03-aba9-10764debad44 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9652024-11-22T04:01:07.022ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2412 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d212fee5-6fba-4b03-aba9-10764debad44 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9662024-11-22T04:01:08.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f9175727-a1f1-4b86-bc73-6f358c5552ac roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9672024-11-22T04:01:08.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f9175727-a1f1-4b86-bc73-6f358c5552ac resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9682024-11-22T04:01:08.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1634 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f9175727-a1f1-4b86-bc73-6f358c5552ac response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9692024-11-22T04:01:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
9702024-11-22T04:01:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9712024-11-22T04:01:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
9722024-11-22T04:01:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9732024-11-22T04:01:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9742024-11-22T04:01:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9752024-11-22T04:01:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9762024-11-22T04:01:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9772024-11-22T04:01:08.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9782024-11-22T04:01:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9792024-11-22T04:01:08.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9802024-11-22T04:01:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9812024-11-22T04:01:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9822024-11-22T04:01:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
9832024-11-22T04:01:08.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9842024-11-22T04:01:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9852024-11-22T04:01:08.462ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
9862024-11-22T04:01:08.462ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.343801ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
9872024-11-22T04:01:08.466ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9882024-11-22T04:01:08.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9892024-11-22T04:01:08.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.038307ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9902024-11-22T04:01:09.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 294a4c9a-9c56-452a-9b03-098664a32480 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9912024-11-22T04:01:09.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 294a4c9a-9c56-452a-9b03-098664a32480 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9922024-11-22T04:01:09.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 294a4c9a-9c56-452a-9b03-098664a32480 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9932024-11-22T04:01:10.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6dcd1174-49d8-4259-b598-6e306302aef8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9942024-11-22T04:01:10.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6dcd1174-49d8-4259-b598-6e306302aef8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9952024-11-22T04:01:10.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6dcd1174-49d8-4259-b598-6e306302aef8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
9962024-11-22T04:01:10.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = b6d8c45a-6dad-4540-aac6-86a482ebb3bb roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
9972024-11-22T04:01:10.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = b6d8c45a-6dad-4540-aac6-86a482ebb3bb resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
9982024-11-22T04:01:10.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = b6d8c45a-6dad-4540-aac6-86a482ebb3bb response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
9992024-11-22T04:01:10.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 33904ba1-62c9-4dfb-a926-a1a365b45259 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
10002024-11-22T04:01:10.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 33904ba1-62c9-4dfb-a926-a1a365b45259 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
10012024-11-22T04:01:10.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2565 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 33904ba1-62c9-4dfb-a926-a1a365b45259 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
10022024-11-22T04:01:10.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 524 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 2fdbf77f-a62b-4fb9-8dfd-b11cec39cc95 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
10032024-11-22T04:01:11.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b0178a48-7f9c-4b0b-a4bc-9070bf93fce1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10042024-11-22T04:01:11.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b0178a48-7f9c-4b0b-a4bc-9070bf93fce1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10052024-11-22T04:01:11.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b0178a48-7f9c-4b0b-a4bc-9070bf93fce1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10062024-11-22T04:01:12.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b05afcfa-193d-46b6-920a-994f6d3fae5d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10072024-11-22T04:01:12.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b05afcfa-193d-46b6-920a-994f6d3fae5d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10082024-11-22T04:01:12.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b05afcfa-193d-46b6-920a-994f6d3fae5d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10092024-11-22T04:01:13.151ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1814ca1b-5c24-424f-9729-502971c7642c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10102024-11-22T04:01:13.151ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1814ca1b-5c24-424f-9729-502971c7642c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10112024-11-22T04:01:13.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1814ca1b-5c24-424f-9729-502971c7642c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10122024-11-22T04:01:14.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ec961f3-5d1b-4c4f-b70b-fc4f2c58d8b4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10132024-11-22T04:01:14.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ec961f3-5d1b-4c4f-b70b-fc4f2c58d8b4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10142024-11-22T04:01:14.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2356 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ec961f3-5d1b-4c4f-b70b-fc4f2c58d8b4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10152024-11-22T04:01:15.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = abb8bc2d-c96c-4506-ac72-3f47195c2f4a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10162024-11-22T04:01:15.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = abb8bc2d-c96c-4506-ac72-3f47195c2f4a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10172024-11-22T04:01:15.195ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = abb8bc2d-c96c-4506-ac72-3f47195c2f4a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10182024-11-22T04:01:16.214ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff74ae52-882e-429b-8c71-2a3a04cb1b5a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10192024-11-22T04:01:16.214ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff74ae52-882e-429b-8c71-2a3a04cb1b5a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10202024-11-22T04:01:16.216ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1902 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff74ae52-882e-429b-8c71-2a3a04cb1b5a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10212024-11-22T04:01:17.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 45572ee9-79ef-4d77-b541-bc43862a9889 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10222024-11-22T04:01:17.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 45572ee9-79ef-4d77-b541-bc43862a9889 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10232024-11-22T04:01:17.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 45572ee9-79ef-4d77-b541-bc43862a9889 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10242024-11-22T04:01:18.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 663092d0-1151-43a1-8a1b-a9ffde8e25b1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10252024-11-22T04:01:18.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 663092d0-1151-43a1-8a1b-a9ffde8e25b1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10262024-11-22T04:01:18.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2346 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 663092d0-1151-43a1-8a1b-a9ffde8e25b1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10272024-11-22T04:01:18.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
10282024-11-22T04:01:18.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10292024-11-22T04:01:18.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
10302024-11-22T04:01:18.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10312024-11-22T04:01:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10322024-11-22T04:01:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10332024-11-22T04:01:18.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10342024-11-22T04:01:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10352024-11-22T04:01:18.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10362024-11-22T04:01:18.440ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.212697ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
10372024-11-22T04:01:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10382024-11-22T04:01:18.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10392024-11-22T04:01:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10402024-11-22T04:01:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10412024-11-22T04:01:18.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10422024-11-22T04:01:18.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10432024-11-22T04:01:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
10442024-11-22T04:01:18.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10452024-11-22T04:01:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10462024-11-22T04:01:18.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
10472024-11-22T04:01:18.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.25543ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
10482024-11-22T04:01:19.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78817dc0-2b8e-4c1e-acde-8ae7cf2c997b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10492024-11-22T04:01:19.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78817dc0-2b8e-4c1e-acde-8ae7cf2c997b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10502024-11-22T04:01:19.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1604 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78817dc0-2b8e-4c1e-acde-8ae7cf2c997b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10512024-11-22T04:01:20.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a9dec00-1ed9-49b9-8b58-6c6b4661ac8b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10522024-11-22T04:01:20.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a9dec00-1ed9-49b9-8b58-6c6b4661ac8b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10532024-11-22T04:01:20.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1949 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a9dec00-1ed9-49b9-8b58-6c6b4661ac8b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10542024-11-22T04:01:20.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 603 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 4bec7db1-4de7-480d-89e0-6eef6ce21782 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
10552024-11-22T04:01:21.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3f6db634-57a1-4c09-98e6-9f91c1820c1c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10562024-11-22T04:01:21.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3f6db634-57a1-4c09-98e6-9f91c1820c1c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10572024-11-22T04:01:21.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2239 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3f6db634-57a1-4c09-98e6-9f91c1820c1c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10582024-11-22T04:01:22.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 83c42bea-56c3-45a8-9aa9-fb1fb42815f0 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10592024-11-22T04:01:22.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 83c42bea-56c3-45a8-9aa9-fb1fb42815f0 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10602024-11-22T04:01:22.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2389 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 83c42bea-56c3-45a8-9aa9-fb1fb42815f0 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10612024-11-22T04:01:23.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 99b8627b-762b-4980-9e68-6ec176b2b177 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10622024-11-22T04:01:23.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 99b8627b-762b-4980-9e68-6ec176b2b177 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10632024-11-22T04:01:23.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 99b8627b-762b-4980-9e68-6ec176b2b177 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10642024-11-22T04:01:24.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dac103ee-eee4-4e49-b8cd-61bb8d0f0c29 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10652024-11-22T04:01:24.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dac103ee-eee4-4e49-b8cd-61bb8d0f0c29 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10662024-11-22T04:01:24.388ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2141 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dac103ee-eee4-4e49-b8cd-61bb8d0f0c29 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10672024-11-22T04:01:25.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b305eed-5a64-4050-8ae6-5eb246ca511a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10682024-11-22T04:01:25.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b305eed-5a64-4050-8ae6-5eb246ca511a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10692024-11-22T04:01:25.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b305eed-5a64-4050-8ae6-5eb246ca511a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10702024-11-22T04:01:26.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a8ff89b7-00eb-458b-9ab5-b87a22b313a6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10712024-11-22T04:01:26.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a8ff89b7-00eb-458b-9ab5-b87a22b313a6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10722024-11-22T04:01:26.433ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2436 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a8ff89b7-00eb-458b-9ab5-b87a22b313a6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10732024-11-22T04:01:27.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 507161bf-600f-478d-98d3-267ace155a1f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10742024-11-22T04:01:27.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 507161bf-600f-478d-98d3-267ace155a1f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10752024-11-22T04:01:27.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 507161bf-600f-478d-98d3-267ace155a1f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
10762024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
10772024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10782024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
10792024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
10802024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10812024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10822024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
10832024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10842024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
10852024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
10862024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10872024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
10882024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
10892024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10902024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10912024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
10922024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10932024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
10942024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10952024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
10962024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10972024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10982024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
10992024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
11002024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11012024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
11022024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
11032024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11042024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
11052024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11062024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
11072024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11082024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
11092024-11-22T04:01:28.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
11102024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11112024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11122024-11-22T04:01:28.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11132024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
11142024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11152024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11162024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11172024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11182024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11192024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11202024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
11212024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11222024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11232024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11242024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11252024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11262024-11-22T04:01:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
11272024-11-22T04:01:28.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 792403893 } })
11282024-11-22T04:01:28.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
11292024-11-22T04:01:28.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11302024-11-22T04:01:28.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.52362ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
11312024-11-22T04:01:28.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 793589154 } })
11322024-11-22T04:01:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11332024-11-22T04:01:28.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
11342024-11-22T04:01:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
11352024-11-22T04:01:28.444ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
11362024-11-22T04:01:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
11372024-11-22T04:01:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11382024-11-22T04:01:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11392024-11-22T04:01:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11402024-11-22T04:01:28.447ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11412024-11-22T04:01:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11422024-11-22T04:01:28.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11432024-11-22T04:01:28.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11442024-11-22T04:01:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11452024-11-22T04:01:28.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11462024-11-22T04:01:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11472024-11-22T04:01:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
11482024-11-22T04:01:28.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
11492024-11-22T04:01:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
11502024-11-22T04:01:28.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11512024-11-22T04:01:28.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11522024-11-22T04:01:28.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11532024-11-22T04:01:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11542024-11-22T04:01:28.458ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1317, tv_nsec: 810149228 } })
11552024-11-22T04:01:28.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11562024-11-22T04:01:28.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
11572024-11-22T04:01:28.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
11582024-11-22T04:01:28.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
11592024-11-22T04:01:28.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
11602024-11-22T04:01:28.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27af0d68-65ed-4654-b351-dbd8cf3a7701 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
11612024-11-22T04:01:28.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27af0d68-65ed-4654-b351-dbd8cf3a7701 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
11622024-11-22T04:01:28.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1928 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27af0d68-65ed-4654-b351-dbd8cf3a7701 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
11632024-11-22T04:01:28.479ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11642024-11-22T04:01:28.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11652024-11-22T04:01:28.480ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 43.280118ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
11662024-11-22T04:01:28.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 46.942893ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
11672024-11-22T04:01:28.490ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11682024-11-22T04:01:28.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11692024-11-22T04:01:28.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11702024-11-22T04:01:28.492ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11712024-11-22T04:01:28.492ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11722024-11-22T04:01:28.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11732024-11-22T04:01:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11742024-11-22T04:01:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11752024-11-22T04:01:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11762024-11-22T04:01:28.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.549503ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
11772024-11-22T04:01:28.494ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11782024-11-22T04:01:28.494ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.704406ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11792024-11-22T04:01:28.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
11802024-11-22T04:01:28.494ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11812024-11-22T04:01:28.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11822024-11-22T04:01:28.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.49078ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11832024-11-22T04:01:28.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11842024-11-22T04:01:28.496ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11852024-11-22T04:01:28.496ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11862024-11-22T04:01:28.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11872024-11-22T04:01:28.497ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea204e31-8f36-405c-ad29-a2cd11c6155c", "content-length": "26", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
11882024-11-22T04:01:28.497ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11892024-11-22T04:01:28.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11902024-11-22T04:01:28.497ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
11912024-11-22T04:01:28.497ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11922024-11-22T04:01:28.498ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4b4094c-b6b2-4783-889d-7f316cb62d36", "content-length": "26", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
11932024-11-22T04:01:28.498ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11942024-11-22T04:01:28.498ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
11952024-11-22T04:01:28.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
11962024-11-22T04:01:28.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
11972024-11-22T04:01:28.499ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11982024-11-22T04:01:28.500ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11992024-11-22T04:01:28.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12002024-11-22T04:01:28.501ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
12012024-11-22T04:01:28.501ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.589608ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12022024-11-22T04:01:28.502ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
12032024-11-22T04:01:28.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12042024-11-22T04:01:28.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12052024-11-22T04:01:28.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
12062024-11-22T04:01:28.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12072024-11-22T04:01:28.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12082024-11-22T04:01:28.515ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
12092024-11-22T04:01:28.515ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
12102024-11-22T04:01:28.515ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
12112024-11-22T04:01:28.515ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.558256ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
12122024-11-22T04:01:28.515ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f69ce5d-c927-497b-a5fe-b7f5bcb9b0de", "content-length": "26", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
12132024-11-22T04:01:28.515ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
12142024-11-22T04:01:28.516ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
12152024-11-22T04:01:28.519ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12162024-11-22T04:01:28.519ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
12172024-11-22T04:01:28.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12182024-11-22T04:01:28.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
12192024-11-22T04:01:28.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 84.255705ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
12202024-11-22T04:01:28.522ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12212024-11-22T04:01:28.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12222024-11-22T04:01:28.527ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12232024-11-22T04:01:28.527ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
12242024-11-22T04:01:28.527ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
12252024-11-22T04:01:28.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
12262024-11-22T04:01:28.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12272024-11-22T04:01:28.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12282024-11-22T04:01:28.555ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12292024-11-22T04:01:28.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
12302024-11-22T04:01:28.557ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
12312024-11-22T04:01:28.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
12322024-11-22T04:01:28.560ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.463823ms iteration = 14 status = 0
12332024-11-22T04:01:28.567ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
12342024-11-22T04:01:28.567ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
12352024-11-22T04:01:28.567ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 129.935526ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
12362024-11-22T04:01:28.570ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 132.360648ms iteration = 16 status = {"physical_disks_added":0}
12372024-11-22T04:01:28.609ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
12382024-11-22T04:01:28.609ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e8a82b8-38fc-4ad6-b3e0-4c2191160802", "content-length": "1", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
12392024-11-22T04:01:28.610ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
12402024-11-22T04:01:28.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
12412024-11-22T04:01:28.612ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 175.561405ms iteration = 14 status = null
12422024-11-22T04:01:28.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12432024-11-22T04:01:28.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12442024-11-22T04:01:28.633ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12452024-11-22T04:01:28.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12462024-11-22T04:01:28.635ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12472024-11-22T04:01:28.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12482024-11-22T04:01:28.637ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12492024-11-22T04:01:28.639ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
12502024-11-22T04:01:28.639ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
12512024-11-22T04:01:28.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
12522024-11-22T04:01:28.689ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
12532024-11-22T04:01:28.689ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12542024-11-22T04:01:28.689ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "41893fe9-599b-4b10-a2b7-94fb90f96570", "content-length": "372", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
12552024-11-22T04:01:28.689ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12562024-11-22T04:01:28.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12572024-11-22T04:01:28.698ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 260.741057ms iteration = 14 status = {}
12582024-11-22T04:01:28.718ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
12592024-11-22T04:01:28.719ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd0788d8-73fd-42a3-a234-cb3ccccfd64a", "content-length": "691", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
12602024-11-22T04:01:28.719ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
12612024-11-22T04:01:28.719ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
12622024-11-22T04:01:28.719ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
12632024-11-22T04:01:28.720ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 283.110574ms iteration = 14 status = {}
12642024-11-22T04:01:28.735ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
12652024-11-22T04:01:28.735ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
12662024-11-22T04:01:28.735ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a7167f23-b9da-4ed3-a661-f9f89303bfd5", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
12672024-11-22T04:01:28.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12682024-11-22T04:01:28.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12692024-11-22T04:01:28.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12702024-11-22T04:01:28.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12712024-11-22T04:01:28.742ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
12722024-11-22T04:01:28.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
12732024-11-22T04:01:28.745ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
12742024-11-22T04:01:28.745ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
12752024-11-22T04:01:28.745ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d100eb46-f302-4a81-bd32-991855695caf", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
12762024-11-22T04:01:28.747ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 309.474661ms iteration = 14 status = {}
12772024-11-22T04:01:28.767ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12782024-11-22T04:01:28.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12792024-11-22T04:01:28.769ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
12802024-11-22T04:01:28.769ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12812024-11-22T04:01:28.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12822024-11-22T04:01:28.779ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
12832024-11-22T04:01:28.779ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a14973c5-b907-478c-bd49-3246bab10dd2", "content-length": "134", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
12842024-11-22T04:01:28.779ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
12852024-11-22T04:01:28.779ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
12862024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
12872024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
12882024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12892024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12902024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12912024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12922024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
12932024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
12942024-11-22T04:01:28.780ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
12952024-11-22T04:01:28.780ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
12962024-11-22T04:01:28.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
12972024-11-22T04:01:28.782ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
12982024-11-22T04:01:28.782ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "207a9c9c-602f-4746-a682-3b34fb011237", "content-length": "2", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
12992024-11-22T04:01:28.782ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
13002024-11-22T04:01:28.782ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "602d9fef-42d0-4c3e-be2e-659186c2d1e4", "content-length": "52", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
13012024-11-22T04:01:28.782ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
13022024-11-22T04:01:28.782ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
13032024-11-22T04:01:28.876ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0c97c8ef-a3ca-4030-b8f7-b3fd07ed1394", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
13042024-11-22T04:01:28.876ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
13052024-11-22T04:01:28.876ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
13062024-11-22T04:01:28.876ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2bddb4b6-33d7-416d-8d5e-00f8a1e6ff6b", "content-length": "682", "date": "Fri, 22 Nov 2024 04:01:28 GMT"} })
13072024-11-22T04:01:28.876ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13082024-11-22T04:01:28.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13092024-11-22T04:01:28.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13102024-11-22T04:01:28.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13112024-11-22T04:01:28.884ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13122024-11-22T04:01:28.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13132024-11-22T04:01:28.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13142024-11-22T04:01:28.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
13152024-11-22T04:01:28.893ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 456.182034ms iteration = 14 status = {}
13162024-11-22T04:01:29.236ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 556068a6-5b6c-42da-93f5-e9c7265d8b0f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
13172024-11-22T04:01:29.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 556068a6-5b6c-42da-93f5-e9c7265d8b0f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
13182024-11-22T04:01:29.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3506 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 556068a6-5b6c-42da-93f5-e9c7265d8b0f response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
13192024-11-22T04:01:29.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 053db007-af24-41e3-bdf3-0b2d821ad8ec roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13202024-11-22T04:01:29.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 053db007-af24-41e3-bdf3-0b2d821ad8ec resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13212024-11-22T04:01:29.508ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1427 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 053db007-af24-41e3-bdf3-0b2d821ad8ec response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13222024-11-22T04:01:30.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ac290a0-b2e7-4b91-af1c-59381cafea7d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13232024-11-22T04:01:30.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ac290a0-b2e7-4b91-af1c-59381cafea7d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13242024-11-22T04:01:30.530ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2019 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ac290a0-b2e7-4b91-af1c-59381cafea7d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13252024-11-22T04:01:30.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 539 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 62aa2459-ae25-4de9-9a12-bdc435cbe096 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
13262024-11-22T04:01:31.548ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 06a50f26-ba12-4001-bbfa-9433521aa7c8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13272024-11-22T04:01:31.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 06a50f26-ba12-4001-bbfa-9433521aa7c8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13282024-11-22T04:01:31.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1834 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 06a50f26-ba12-4001-bbfa-9433521aa7c8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13292024-11-22T04:01:32.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c8dc7f5b-c850-45e0-beeb-e893d4bdfd65 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13302024-11-22T04:01:32.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c8dc7f5b-c850-45e0-beeb-e893d4bdfd65 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13312024-11-22T04:01:32.572ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2579 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c8dc7f5b-c850-45e0-beeb-e893d4bdfd65 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13322024-11-22T04:01:33.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 580d71e7-7fd4-4642-ac19-25beb1a95e94 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13332024-11-22T04:01:33.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 580d71e7-7fd4-4642-ac19-25beb1a95e94 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13342024-11-22T04:01:33.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 580d71e7-7fd4-4642-ac19-25beb1a95e94 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13352024-11-22T04:01:34.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1d383093-5029-4020-8f26-bc67d2538b3c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13362024-11-22T04:01:34.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1d383093-5029-4020-8f26-bc67d2538b3c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13372024-11-22T04:01:34.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1d383093-5029-4020-8f26-bc67d2538b3c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13382024-11-22T04:01:35.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b0ca3e22-a429-4c67-8993-e113a74fc312 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13392024-11-22T04:01:35.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b0ca3e22-a429-4c67-8993-e113a74fc312 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13402024-11-22T04:01:35.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2396 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b0ca3e22-a429-4c67-8993-e113a74fc312 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13412024-11-22T04:01:36.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1e43ae5c-3549-4377-a1a1-dab2c85bd006 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13422024-11-22T04:01:36.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1e43ae5c-3549-4377-a1a1-dab2c85bd006 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13432024-11-22T04:01:36.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1e43ae5c-3549-4377-a1a1-dab2c85bd006 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13442024-11-22T04:01:37.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08e997a9-7b6b-4fbd-8067-b8a337ff35a4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13452024-11-22T04:01:37.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08e997a9-7b6b-4fbd-8067-b8a337ff35a4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13462024-11-22T04:01:37.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08e997a9-7b6b-4fbd-8067-b8a337ff35a4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13472024-11-22T04:01:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
13482024-11-22T04:01:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
13492024-11-22T04:01:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13502024-11-22T04:01:38.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13512024-11-22T04:01:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13522024-11-22T04:01:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13532024-11-22T04:01:38.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13542024-11-22T04:01:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13552024-11-22T04:01:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13562024-11-22T04:01:38.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.172674ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13572024-11-22T04:01:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13582024-11-22T04:01:38.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13592024-11-22T04:01:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13602024-11-22T04:01:38.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13612024-11-22T04:01:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13622024-11-22T04:01:38.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13632024-11-22T04:01:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
13642024-11-22T04:01:38.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13652024-11-22T04:01:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13662024-11-22T04:01:38.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
13672024-11-22T04:01:38.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.516846ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
13682024-11-22T04:01:38.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7262e50d-27b5-4731-bf56-8fdda1145d67 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13692024-11-22T04:01:38.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7262e50d-27b5-4731-bf56-8fdda1145d67 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13702024-11-22T04:01:38.698ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7262e50d-27b5-4731-bf56-8fdda1145d67 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13712024-11-22T04:01:39.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3bd19269-0d2e-421f-ac7d-b407d8acb090 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13722024-11-22T04:01:39.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3bd19269-0d2e-421f-ac7d-b407d8acb090 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13732024-11-22T04:01:39.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3bd19269-0d2e-421f-ac7d-b407d8acb090 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13742024-11-22T04:01:40.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = bd5c1ba4-44de-45b2-9fb3-ca095226f024 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
13752024-11-22T04:01:40.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = bd5c1ba4-44de-45b2-9fb3-ca095226f024 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
13762024-11-22T04:01:40.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = bd5c1ba4-44de-45b2-9fb3-ca095226f024 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
13772024-11-22T04:01:40.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 1577e15e-c9e5-454a-b2b4-faa391903fe9 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
13782024-11-22T04:01:40.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 1577e15e-c9e5-454a-b2b4-faa391903fe9 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
13792024-11-22T04:01:40.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:47015 req_id = 1577e15e-c9e5-454a-b2b4-faa391903fe9 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
13802024-11-22T04:01:40.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 501 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 4ea55dbc-450d-42c8-99f7-1c74049bf0d0 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
13812024-11-22T04:01:40.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43254725-1f9a-4167-84ad-fd712e627540 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13822024-11-22T04:01:40.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43254725-1f9a-4167-84ad-fd712e627540 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13832024-11-22T04:01:40.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2380 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43254725-1f9a-4167-84ad-fd712e627540 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13842024-11-22T04:01:41.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 44a6674c-1b5d-4bc0-9c3d-029eddc9e3a7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13852024-11-22T04:01:41.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 44a6674c-1b5d-4bc0-9c3d-029eddc9e3a7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13862024-11-22T04:01:41.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1479 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 44a6674c-1b5d-4bc0-9c3d-029eddc9e3a7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13872024-11-22T04:01:42.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9fb42e56-b13d-4740-908d-97f4932d6a21 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13882024-11-22T04:01:42.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9fb42e56-b13d-4740-908d-97f4932d6a21 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13892024-11-22T04:01:42.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2415 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9fb42e56-b13d-4740-908d-97f4932d6a21 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13902024-11-22T04:01:43.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f076533-c148-4933-bac0-faf0f0952d3c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13912024-11-22T04:01:43.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f076533-c148-4933-bac0-faf0f0952d3c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13922024-11-22T04:01:43.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f076533-c148-4933-bac0-faf0f0952d3c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13932024-11-22T04:01:44.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7812269f-5813-45b1-8688-62feafa006b6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13942024-11-22T04:01:44.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7812269f-5813-45b1-8688-62feafa006b6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13952024-11-22T04:01:44.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7812269f-5813-45b1-8688-62feafa006b6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13962024-11-22T04:01:45.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 44a22555-ca6f-48e0-874e-238c9524e1e1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13972024-11-22T04:01:45.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 44a22555-ca6f-48e0-874e-238c9524e1e1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13982024-11-22T04:01:45.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2529 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 44a22555-ca6f-48e0-874e-238c9524e1e1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
13992024-11-22T04:01:46.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2f9fda43-d69b-4d6b-8d59-142964a3e70a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14002024-11-22T04:01:46.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2f9fda43-d69b-4d6b-8d59-142964a3e70a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14012024-11-22T04:01:46.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1797 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2f9fda43-d69b-4d6b-8d59-142964a3e70a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14022024-11-22T04:01:47.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ad3871a-edc1-4b19-aed9-c2e0108aab7c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14032024-11-22T04:01:47.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ad3871a-edc1-4b19-aed9-c2e0108aab7c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14042024-11-22T04:01:47.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1969 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ad3871a-edc1-4b19-aed9-c2e0108aab7c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14052024-11-22T04:01:48.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
14062024-11-22T04:01:48.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
14072024-11-22T04:01:48.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14082024-11-22T04:01:48.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14092024-11-22T04:01:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14102024-11-22T04:01:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14112024-11-22T04:01:48.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14122024-11-22T04:01:48.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14132024-11-22T04:01:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14142024-11-22T04:01:48.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.373777ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14152024-11-22T04:01:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14162024-11-22T04:01:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14172024-11-22T04:01:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14182024-11-22T04:01:48.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14192024-11-22T04:01:48.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14202024-11-22T04:01:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14212024-11-22T04:01:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
14222024-11-22T04:01:48.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14232024-11-22T04:01:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14242024-11-22T04:01:48.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
14252024-11-22T04:01:48.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.405367ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
14262024-11-22T04:01:48.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3902a18e-7fd4-43bd-801a-3ed2b54f1421 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14272024-11-22T04:01:48.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3902a18e-7fd4-43bd-801a-3ed2b54f1421 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14282024-11-22T04:01:48.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2397 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3902a18e-7fd4-43bd-801a-3ed2b54f1421 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14292024-11-22T04:01:49.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2ecb53b0-45f9-42f5-ae3d-c12a5e0e5c9b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14302024-11-22T04:01:49.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2ecb53b0-45f9-42f5-ae3d-c12a5e0e5c9b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14312024-11-22T04:01:49.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2ecb53b0-45f9-42f5-ae3d-c12a5e0e5c9b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14322024-11-22T04:01:50.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 596 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 86030465-7876-4e03-a071-bd1b8aa925cc response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
14332024-11-22T04:01:50.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c0251836-2647-4c6d-a1ce-042594a2805c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14342024-11-22T04:01:50.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c0251836-2647-4c6d-a1ce-042594a2805c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14352024-11-22T04:01:50.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c0251836-2647-4c6d-a1ce-042594a2805c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14362024-11-22T04:01:51.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df1f4435-73d4-4450-ae35-1f9d1c8f1b14 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14372024-11-22T04:01:51.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df1f4435-73d4-4450-ae35-1f9d1c8f1b14 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14382024-11-22T04:01:51.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2134 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df1f4435-73d4-4450-ae35-1f9d1c8f1b14 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14392024-11-22T04:01:52.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 13556d7c-3302-482b-b06d-fe75b056d1e1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14402024-11-22T04:01:52.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 13556d7c-3302-482b-b06d-fe75b056d1e1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14412024-11-22T04:01:52.998ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 13556d7c-3302-482b-b06d-fe75b056d1e1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14422024-11-22T04:01:54.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8bb1eefb-5334-4d6a-8fa6-4751cc10adde roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14432024-11-22T04:01:54.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8bb1eefb-5334-4d6a-8fa6-4751cc10adde resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14442024-11-22T04:01:54.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8bb1eefb-5334-4d6a-8fa6-4751cc10adde response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14452024-11-22T04:01:55.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a06475b1-8404-4059-9887-2c836786a2b3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14462024-11-22T04:01:55.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a06475b1-8404-4059-9887-2c836786a2b3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14472024-11-22T04:01:55.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a06475b1-8404-4059-9887-2c836786a2b3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14482024-11-22T04:01:56.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 96c3a477-2d10-434f-b96a-ef56f12a2832 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14492024-11-22T04:01:56.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 96c3a477-2d10-434f-b96a-ef56f12a2832 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14502024-11-22T04:01:56.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 96c3a477-2d10-434f-b96a-ef56f12a2832 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14512024-11-22T04:01:57.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dbc3ffe5-4d2c-4b0a-aeda-3fbb9ae9eee9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14522024-11-22T04:01:57.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dbc3ffe5-4d2c-4b0a-aeda-3fbb9ae9eee9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14532024-11-22T04:01:57.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dbc3ffe5-4d2c-4b0a-aeda-3fbb9ae9eee9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14542024-11-22T04:01:58.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aca02081-22e5-40b8-8e4f-ba7092e3d740 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14552024-11-22T04:01:58.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aca02081-22e5-40b8-8e4f-ba7092e3d740 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14562024-11-22T04:01:58.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2165 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aca02081-22e5-40b8-8e4f-ba7092e3d740 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
14572024-11-22T04:01:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
14582024-11-22T04:01:58.436ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
14592024-11-22T04:01:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
14602024-11-22T04:01:58.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14612024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
14622024-11-22T04:01:58.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 788662577 } })
14632024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
14642024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
14652024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14662024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
14672024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
14682024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
14692024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
14702024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
14712024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
14722024-11-22T04:01:58.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
14732024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
14742024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.21\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
14752024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
14762024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
14772024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
14782024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
14792024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14802024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14812024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14822024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
14832024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
14842024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
14852024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
14862024-11-22T04:01:58.437ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:51:58.437485758 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
14872024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
14882024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
14892024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14902024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
14912024-11-22T04:01:58.437ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
14922024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
14932024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
14942024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14952024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
14962024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
14972024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
14982024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
14992024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15002024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15012024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
15022024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
15032024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
15042024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
15052024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15062024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
15072024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
15082024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
15092024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15102024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15112024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
15122024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
15132024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
15142024-11-22T04:01:58.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
15152024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15162024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15172024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
15182024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
15192024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
15202024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
15212024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
15222024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
15232024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15242024-11-22T04:01:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15252024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
15262024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15272024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
15282024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15292024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15302024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
15312024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15322024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
15332024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
15342024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15352024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15362024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
15372024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15382024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15392024-11-22T04:01:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 789615234 } })
15402024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.478366ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
15412024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
15422024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15432024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
15442024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
15452024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15462024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15472024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
15482024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
15492024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
15502024-11-22T04:01:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.209332ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
15512024-11-22T04:01:58.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 792108478 } })
15522024-11-22T04:01:58.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
15532024-11-22T04:01:58.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.37401ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
15542024-11-22T04:01:58.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
15552024-11-22T04:01:58.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
15562024-11-22T04:01:58.442ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:51:58.437485758 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
15572024-11-22T04:01:58.442ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.385636ms iteration = 8 status = {"expiration":"2024-11-22T03:51:58.437485758Z","pruned":[]}
15582024-11-22T04:01:58.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15592024-11-22T04:01:58.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15602024-11-22T04:01:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
15612024-11-22T04:01:58.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
15622024-11-22T04:01:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
15632024-11-22T04:01:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
15642024-11-22T04:01:58.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15652024-11-22T04:01:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15662024-11-22T04:01:58.454ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15672024-11-22T04:01:58.456ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.878615ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
15682024-11-22T04:01:58.456ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15692024-11-22T04:01:58.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
15702024-11-22T04:01:58.457ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
15712024-11-22T04:01:58.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15722024-11-22T04:01:58.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
15732024-11-22T04:01:58.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15742024-11-22T04:01:58.459ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
15752024-11-22T04:01:58.459ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15762024-11-22T04:01:58.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15772024-11-22T04:01:58.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15782024-11-22T04:01:58.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
15792024-11-22T04:01:58.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15802024-11-22T04:01:58.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15812024-11-22T04:01:58.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15822024-11-22T04:01:58.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15832024-11-22T04:01:58.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15842024-11-22T04:01:58.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15852024-11-22T04:01:58.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15862024-11-22T04:01:58.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15872024-11-22T04:01:58.465ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15882024-11-22T04:01:58.465ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
15892024-11-22T04:01:58.466ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15902024-11-22T04:01:58.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15912024-11-22T04:01:58.467ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 818465855 } })
15922024-11-22T04:01:58.467ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
15932024-11-22T04:01:58.468ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15942024-11-22T04:01:58.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15952024-11-22T04:01:58.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15962024-11-22T04:01:58.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15972024-11-22T04:01:58.471ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
15982024-11-22T04:01:58.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
15992024-11-22T04:01:58.472ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1347, tv_nsec: 824282129 } })
16002024-11-22T04:01:58.473ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
16012024-11-22T04:01:58.477ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16022024-11-22T04:01:58.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16032024-11-22T04:01:58.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16042024-11-22T04:01:58.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16052024-11-22T04:01:58.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16062024-11-22T04:01:58.502ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.586096ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
16072024-11-22T04:01:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
16082024-11-22T04:01:58.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16092024-11-22T04:01:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16102024-11-22T04:01:58.507ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
16112024-11-22T04:01:58.507ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
16122024-11-22T04:01:58.507ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.632846ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
16132024-11-22T04:01:58.508ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16142024-11-22T04:01:58.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16152024-11-22T04:01:58.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.453594ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
16162024-11-22T04:01:58.514ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16172024-11-22T04:01:58.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
16182024-11-22T04:01:58.515ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16192024-11-22T04:01:58.516ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16202024-11-22T04:01:58.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
16212024-11-22T04:01:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
16222024-11-22T04:01:58.518ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16232024-11-22T04:01:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16242024-11-22T04:01:58.519ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
16252024-11-22T04:01:58.519ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 82.503124ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
16262024-11-22T04:01:58.520ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16272024-11-22T04:01:58.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16282024-11-22T04:01:58.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16292024-11-22T04:01:58.521ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
16302024-11-22T04:01:58.521ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
16312024-11-22T04:01:58.521ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.776106ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
16322024-11-22T04:01:58.521ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16332024-11-22T04:01:58.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16342024-11-22T04:01:58.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16352024-11-22T04:01:58.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16362024-11-22T04:01:58.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16372024-11-22T04:01:58.524ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 86.640098ms iteration = 17 status = {"physical_disks_added":0}
16382024-11-22T04:01:58.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16392024-11-22T04:01:58.525ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16402024-11-22T04:01:58.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16412024-11-22T04:01:58.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16422024-11-22T04:01:58.526ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
16432024-11-22T04:01:58.526ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.207863ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
16442024-11-22T04:01:58.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16452024-11-22T04:01:58.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16462024-11-22T04:01:58.531ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
16472024-11-22T04:01:58.531ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16482024-11-22T04:01:58.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16492024-11-22T04:01:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16502024-11-22T04:01:58.533ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16512024-11-22T04:01:58.534ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
16522024-11-22T04:01:58.534ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16532024-11-22T04:01:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16542024-11-22T04:01:58.536ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.728862ms iteration = 15 status = 0
16552024-11-22T04:01:58.536ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16562024-11-22T04:01:58.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16572024-11-22T04:01:58.543ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.814048ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
16582024-11-22T04:01:58.554ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16592024-11-22T04:01:58.554ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 117.053297ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16602024-11-22T04:01:58.557ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16612024-11-22T04:01:58.557ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16622024-11-22T04:01:58.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16632024-11-22T04:01:58.567ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.758433ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16642024-11-22T04:01:58.569ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 131.521194ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16652024-11-22T04:01:58.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16662024-11-22T04:01:58.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
16672024-11-22T04:01:58.573ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16682024-11-22T04:01:58.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16692024-11-22T04:01:58.574ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16702024-11-22T04:01:58.574ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16712024-11-22T04:01:58.574ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16722024-11-22T04:01:58.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16732024-11-22T04:01:58.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16742024-11-22T04:01:58.575ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
16752024-11-22T04:01:58.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16762024-11-22T04:01:58.575ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16772024-11-22T04:01:58.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
16782024-11-22T04:01:58.579ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
16792024-11-22T04:01:58.579ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
16802024-11-22T04:01:58.579ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
16812024-11-22T04:01:58.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16822024-11-22T04:01:58.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16832024-11-22T04:01:58.580ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16842024-11-22T04:01:58.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16852024-11-22T04:01:58.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16862024-11-22T04:01:58.583ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
16872024-11-22T04:01:58.583ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
16882024-11-22T04:01:58.583ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.177214ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
16892024-11-22T04:01:58.585ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16902024-11-22T04:01:58.585ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
16912024-11-22T04:01:58.585ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c8b034f-3181-47c5-b671-b9769941b848", "content-length": "26", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
16922024-11-22T04:01:58.585ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
16932024-11-22T04:01:58.587ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
16942024-11-22T04:01:58.593ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16952024-11-22T04:01:58.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16962024-11-22T04:01:58.611ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16972024-11-22T04:01:58.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16982024-11-22T04:01:58.620ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
16992024-11-22T04:01:58.620ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17002024-11-22T04:01:58.621ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1252bec2-e59a-4965-be49-448351748f05", "content-length": "26", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
17012024-11-22T04:01:58.621ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17022024-11-22T04:01:58.622ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17032024-11-22T04:01:58.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
17042024-11-22T04:01:58.751ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
17052024-11-22T04:01:58.752ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c4924ab-0ba0-48c3-b7ea-e62bd28c22ee", "content-length": "1", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
17062024-11-22T04:01:58.753ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
17072024-11-22T04:01:58.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
17082024-11-22T04:01:58.759ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17092024-11-22T04:01:58.759ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17102024-11-22T04:01:58.759ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6027513-d199-4e9f-9ea8-91e083424347", "content-length": "372", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
17112024-11-22T04:01:58.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17122024-11-22T04:01:58.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17132024-11-22T04:01:58.761ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17142024-11-22T04:01:58.762ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
17152024-11-22T04:01:58.762ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
17162024-11-22T04:01:58.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17172024-11-22T04:01:58.762ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17182024-11-22T04:01:58.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17192024-11-22T04:01:58.762ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17202024-11-22T04:01:58.764ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
17212024-11-22T04:01:58.764ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17222024-11-22T04:01:58.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17232024-11-22T04:01:58.764ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17242024-11-22T04:01:58.764ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b56979b-b82e-4196-b830-98d4d35b980d", "content-length": "26", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
17252024-11-22T04:01:58.764ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17262024-11-22T04:01:58.764ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17272024-11-22T04:01:58.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17282024-11-22T04:01:58.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17292024-11-22T04:01:58.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17302024-11-22T04:01:58.765ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17312024-11-22T04:01:58.765ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17322024-11-22T04:01:58.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17332024-11-22T04:01:58.766ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
17342024-11-22T04:01:58.766ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17352024-11-22T04:01:58.767ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.611688ms iteration = 15 status = null
17362024-11-22T04:01:58.768ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17372024-11-22T04:01:58.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17382024-11-22T04:01:58.769ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17392024-11-22T04:01:58.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17402024-11-22T04:01:58.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17412024-11-22T04:01:58.770ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17422024-11-22T04:01:58.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17432024-11-22T04:01:58.772ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
17442024-11-22T04:01:58.772ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17452024-11-22T04:01:58.772ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
17462024-11-22T04:01:58.772ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 334.924502ms iteration = 8 status = {"generation":2}
17472024-11-22T04:01:58.788ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
17482024-11-22T04:01:58.788ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17492024-11-22T04:01:58.788ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "64bfa0e2-cc86-4aa4-8f4a-27b59030980b", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
17502024-11-22T04:01:58.788ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17512024-11-22T04:01:58.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17522024-11-22T04:01:58.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17532024-11-22T04:01:58.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17542024-11-22T04:01:58.796ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17552024-11-22T04:01:58.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17562024-11-22T04:01:58.799ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
17572024-11-22T04:01:58.799ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17582024-11-22T04:01:58.799ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "4621b1e6-226a-4451-a6cb-eee4b9c120f3", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
17592024-11-22T04:01:58.800ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 363.074352ms iteration = 15 status = {}
17602024-11-22T04:01:58.802ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17612024-11-22T04:01:58.802ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17622024-11-22T04:01:58.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17632024-11-22T04:01:58.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17642024-11-22T04:01:58.803ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17652024-11-22T04:01:58.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17662024-11-22T04:01:58.809ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17672024-11-22T04:01:58.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17682024-11-22T04:01:58.811ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) }
17692024-11-22T04:01:58.811ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 373.388075ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17702024-11-22T04:01:58.813ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17712024-11-22T04:01:58.813ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17722024-11-22T04:01:58.813ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
17732024-11-22T04:01:58.813ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 376.393898ms iteration = 8 status = {"generation":1}
17742024-11-22T04:01:58.838ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17752024-11-22T04:01:58.839ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "db626615-d676-40a8-b73a-cda91cb5a96a", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17762024-11-22T04:01:58.839ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17772024-11-22T04:01:58.841ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "64f1d98a-0586-40a8-aa74-c2042deb6129", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17782024-11-22T04:01:58.841ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17792024-11-22T04:01:58.842ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
17802024-11-22T04:01:58.842ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 404.884644ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
17812024-11-22T04:01:58.845ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
17822024-11-22T04:01:58.845ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 408.244103ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
17832024-11-22T04:01:58.852ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17842024-11-22T04:01:58.862ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 424.308639ms iteration = 15 status = {}
17852024-11-22T04:01:58.932ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
17862024-11-22T04:01:58.933ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
17872024-11-22T04:01:58.933ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b72ede86-80fc-493e-8cf0-db017b0de4f0", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17882024-11-22T04:01:58.933ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17892024-11-22T04:01:58.934ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "898c2748-b7eb-44be-9078-8cec213a8823", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17902024-11-22T04:01:58.934ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17912024-11-22T04:01:58.936ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "43eb4ab9-0165-4ef5-8c07-b13dc2988fb8", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17922024-11-22T04:01:58.936ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17932024-11-22T04:01:58.937ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
17942024-11-22T04:01:58.937ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 500.302687ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
17952024-11-22T04:01:58.966ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17962024-11-22T04:01:58.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17972024-11-22T04:01:58.968ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
17982024-11-22T04:01:58.968ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17992024-11-22T04:01:58.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18002024-11-22T04:01:58.978ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
18012024-11-22T04:01:58.979ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "110c5590-d55d-43f1-a735-a52472c01e22", "content-length": "134", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
18022024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
18032024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
18042024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
18052024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
18062024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18072024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18082024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18092024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18102024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
18112024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
18122024-11-22T04:01:58.979ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
18132024-11-22T04:01:58.979ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18142024-11-22T04:01:58.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18152024-11-22T04:01:58.982ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
18162024-11-22T04:01:58.982ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4edccc3-f3ff-471b-800c-ba1c08bf7eb9", "content-length": "2", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
18172024-11-22T04:01:58.982ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
18182024-11-22T04:01:58.982ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "519b56de-75df-4a5c-9bd1-e407e7365de6", "content-length": "52", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
18192024-11-22T04:01:58.982ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
18202024-11-22T04:01:58.982ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
18212024-11-22T04:01:59.010ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9719d09-ff02-47bb-b1fd-9d896dcec471", "content-length": "691", "date": "Fri, 22 Nov 2024 04:01:59 GMT"} })
18222024-11-22T04:01:59.010ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
18232024-11-22T04:01:59.010ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
18242024-11-22T04:01:59.010ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
18252024-11-22T04:01:59.012ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 574.82026ms iteration = 15 status = {}
18262024-11-22T04:01:59.103ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "41c0759b-95b6-4319-abba-77a88d357110", "date": "Fri, 22 Nov 2024 04:01:58 GMT"} })
18272024-11-22T04:01:59.103ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
18282024-11-22T04:01:59.103ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
18292024-11-22T04:01:59.104ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "499339aa-0320-490e-8e0a-f19b88da6e1f", "content-length": "682", "date": "Fri, 22 Nov 2024 04:01:59 GMT"} })
18302024-11-22T04:01:59.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18312024-11-22T04:01:59.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18322024-11-22T04:01:59.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18332024-11-22T04:01:59.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18342024-11-22T04:01:59.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18352024-11-22T04:01:59.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18362024-11-22T04:01:59.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18372024-11-22T04:01:59.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18382024-11-22T04:01:59.121ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 684.006997ms iteration = 15 status = {}
18392024-11-22T04:01:59.123ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 91166f39-aadd-4a19-a615-ca1577ef2a48 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18402024-11-22T04:01:59.124ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 91166f39-aadd-4a19-a615-ca1577ef2a48 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18412024-11-22T04:01:59.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2068 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 91166f39-aadd-4a19-a615-ca1577ef2a48 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18422024-11-22T04:01:59.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = e375d384-7d11-4f49-bb4d-a09212f94e24 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
18432024-11-22T04:01:59.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = e375d384-7d11-4f49-bb4d-a09212f94e24 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
18442024-11-22T04:01:59.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3337 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = e375d384-7d11-4f49-bb4d-a09212f94e24 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
18452024-11-22T04:02:00.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9fc77fda-861c-4fd5-8c17-cde36131855e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18462024-11-22T04:02:00.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9fc77fda-861c-4fd5-8c17-cde36131855e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18472024-11-22T04:02:00.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9fc77fda-861c-4fd5-8c17-cde36131855e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18482024-11-22T04:02:00.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = f26d9327-020f-4509-b071-a4c11ce6e961 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
18492024-11-22T04:02:01.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 960b8f12-951c-4387-9a73-58af6c86bf6a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18502024-11-22T04:02:01.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 960b8f12-951c-4387-9a73-58af6c86bf6a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18512024-11-22T04:02:01.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2088 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 960b8f12-951c-4387-9a73-58af6c86bf6a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18522024-11-22T04:02:02.184ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 66c05d17-e2bf-4a86-904f-c1cca37cb2aa roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18532024-11-22T04:02:02.185ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 66c05d17-e2bf-4a86-904f-c1cca37cb2aa resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18542024-11-22T04:02:02.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 66c05d17-e2bf-4a86-904f-c1cca37cb2aa response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18552024-11-22T04:02:03.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ccd4725-6e9d-4c09-abe3-030cd0dd0056 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18562024-11-22T04:02:03.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ccd4725-6e9d-4c09-abe3-030cd0dd0056 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18572024-11-22T04:02:03.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2090 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ccd4725-6e9d-4c09-abe3-030cd0dd0056 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18582024-11-22T04:02:04.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a5a94bfa-c8fa-4e20-96ab-321b75056f3e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18592024-11-22T04:02:04.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a5a94bfa-c8fa-4e20-96ab-321b75056f3e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18602024-11-22T04:02:04.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a5a94bfa-c8fa-4e20-96ab-321b75056f3e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18612024-11-22T04:02:05.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39ba5d9c-333f-4456-8fa7-1ae5230654ce roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18622024-11-22T04:02:05.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39ba5d9c-333f-4456-8fa7-1ae5230654ce resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18632024-11-22T04:02:05.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2002 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39ba5d9c-333f-4456-8fa7-1ae5230654ce response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18642024-11-22T04:02:06.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9ff2611-3c02-4453-85e2-b778c54e9670 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18652024-11-22T04:02:06.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9ff2611-3c02-4453-85e2-b778c54e9670 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18662024-11-22T04:02:06.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9ff2611-3c02-4453-85e2-b778c54e9670 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18672024-11-22T04:02:07.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0dd5feb5-9030-48da-b465-f2a866160a8d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18682024-11-22T04:02:07.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0dd5feb5-9030-48da-b465-f2a866160a8d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18692024-11-22T04:02:07.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1682 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0dd5feb5-9030-48da-b465-f2a866160a8d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18702024-11-22T04:02:08.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2720f4f7-0c92-4ca8-8473-101c6c6b0965 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18712024-11-22T04:02:08.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2720f4f7-0c92-4ca8-8473-101c6c6b0965 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18722024-11-22T04:02:08.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2079 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2720f4f7-0c92-4ca8-8473-101c6c6b0965 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18732024-11-22T04:02:08.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
18742024-11-22T04:02:08.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
18752024-11-22T04:02:08.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18762024-11-22T04:02:08.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18772024-11-22T04:02:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18782024-11-22T04:02:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18792024-11-22T04:02:08.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18802024-11-22T04:02:08.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
18812024-11-22T04:02:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18822024-11-22T04:02:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
18832024-11-22T04:02:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18842024-11-22T04:02:08.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18852024-11-22T04:02:08.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.53487ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18862024-11-22T04:02:08.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18872024-11-22T04:02:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18882024-11-22T04:02:08.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18892024-11-22T04:02:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
18902024-11-22T04:02:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18912024-11-22T04:02:08.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18922024-11-22T04:02:08.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
18932024-11-22T04:02:08.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.293634ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
18942024-11-22T04:02:09.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c142603a-a985-4021-ac82-78e4cc1306aa roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18952024-11-22T04:02:09.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c142603a-a985-4021-ac82-78e4cc1306aa resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18962024-11-22T04:02:09.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c142603a-a985-4021-ac82-78e4cc1306aa response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18972024-11-22T04:02:10.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd016db0-a44a-43b5-96cb-027457598581 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18982024-11-22T04:02:10.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd016db0-a44a-43b5-96cb-027457598581 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
18992024-11-22T04:02:10.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd016db0-a44a-43b5-96cb-027457598581 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19002024-11-22T04:02:10.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 553 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 232f676f-c99e-4a74-be1c-6ee99d6b6ef5 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
19012024-11-22T04:02:11.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b4b3461f-86d9-439e-9fec-bc39868f2dd9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19022024-11-22T04:02:11.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b4b3461f-86d9-439e-9fec-bc39868f2dd9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19032024-11-22T04:02:11.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b4b3461f-86d9-439e-9fec-bc39868f2dd9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19042024-11-22T04:02:12.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 871d5639-f161-4455-a289-d99ebd3d0a28 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19052024-11-22T04:02:12.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 871d5639-f161-4455-a289-d99ebd3d0a28 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19062024-11-22T04:02:12.399ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1921 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 871d5639-f161-4455-a289-d99ebd3d0a28 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19072024-11-22T04:02:13.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3598a6fe-0cac-4d71-8207-601aacde3bf5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19082024-11-22T04:02:13.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3598a6fe-0cac-4d71-8207-601aacde3bf5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19092024-11-22T04:02:13.420ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3598a6fe-0cac-4d71-8207-601aacde3bf5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19102024-11-22T04:02:14.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ad10853a-e3bb-441c-8a24-5184b6dc2df5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19112024-11-22T04:02:14.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ad10853a-e3bb-441c-8a24-5184b6dc2df5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19122024-11-22T04:02:14.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ad10853a-e3bb-441c-8a24-5184b6dc2df5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19132024-11-22T04:02:15.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 561afc9d-d188-47a7-b858-a9948c959525 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19142024-11-22T04:02:15.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 561afc9d-d188-47a7-b858-a9948c959525 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19152024-11-22T04:02:15.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 561afc9d-d188-47a7-b858-a9948c959525 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19162024-11-22T04:02:16.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b07515f0-f8d6-4632-b151-b2f220b0e92b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19172024-11-22T04:02:16.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b07515f0-f8d6-4632-b151-b2f220b0e92b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19182024-11-22T04:02:16.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b07515f0-f8d6-4632-b151-b2f220b0e92b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19192024-11-22T04:02:17.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 25e1184b-f4cb-4d02-8182-6e6949d60529 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19202024-11-22T04:02:17.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 25e1184b-f4cb-4d02-8182-6e6949d60529 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19212024-11-22T04:02:17.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2541 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 25e1184b-f4cb-4d02-8182-6e6949d60529 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19222024-11-22T04:02:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
19232024-11-22T04:02:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
19242024-11-22T04:02:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19252024-11-22T04:02:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19262024-11-22T04:02:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19272024-11-22T04:02:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19282024-11-22T04:02:18.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19292024-11-22T04:02:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19302024-11-22T04:02:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19312024-11-22T04:02:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19322024-11-22T04:02:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19332024-11-22T04:02:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19342024-11-22T04:02:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19352024-11-22T04:02:18.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
19362024-11-22T04:02:18.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19372024-11-22T04:02:18.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19382024-11-22T04:02:18.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
19392024-11-22T04:02:18.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.166794ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
19402024-11-22T04:02:18.471ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19412024-11-22T04:02:18.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19422024-11-22T04:02:18.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.497751ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
19432024-11-22T04:02:18.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 390250ba-40cb-4bc5-96b2-d0280aebf5f0 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19442024-11-22T04:02:18.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 390250ba-40cb-4bc5-96b2-d0280aebf5f0 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19452024-11-22T04:02:18.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2064 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 390250ba-40cb-4bc5-96b2-d0280aebf5f0 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19462024-11-22T04:02:19.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 99a275f3-94bb-446e-b3cd-a2010a574b0f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19472024-11-22T04:02:19.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 99a275f3-94bb-446e-b3cd-a2010a574b0f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19482024-11-22T04:02:19.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 99a275f3-94bb-446e-b3cd-a2010a574b0f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19492024-11-22T04:02:20.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b851a8e7-3bd5-4c89-808f-5233b728f723 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19502024-11-22T04:02:20.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b851a8e7-3bd5-4c89-808f-5233b728f723 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19512024-11-22T04:02:20.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1860 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b851a8e7-3bd5-4c89-808f-5233b728f723 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19522024-11-22T04:02:20.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 654 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 8aab65a0-7121-4877-b0e6-4373fb58f6d6 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
19532024-11-22T04:02:21.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3f33002f-c759-433f-87cf-b08ec119f078 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19542024-11-22T04:02:21.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3f33002f-c759-433f-87cf-b08ec119f078 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19552024-11-22T04:02:21.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3f33002f-c759-433f-87cf-b08ec119f078 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19562024-11-22T04:02:22.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c350e72f-b99c-4b06-826d-caff15325845 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19572024-11-22T04:02:22.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c350e72f-b99c-4b06-826d-caff15325845 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19582024-11-22T04:02:22.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2055 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c350e72f-b99c-4b06-826d-caff15325845 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19592024-11-22T04:02:23.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 00a1970c-7a00-4c9e-8798-ecdf85990964 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19602024-11-22T04:02:23.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 00a1970c-7a00-4c9e-8798-ecdf85990964 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19612024-11-22T04:02:23.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1773 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 00a1970c-7a00-4c9e-8798-ecdf85990964 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19622024-11-22T04:02:24.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5ee6a65d-3b80-41bb-a78e-49cd4e7a415f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19632024-11-22T04:02:24.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5ee6a65d-3b80-41bb-a78e-49cd4e7a415f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19642024-11-22T04:02:24.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2339 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5ee6a65d-3b80-41bb-a78e-49cd4e7a415f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19652024-11-22T04:02:25.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49076085-a8b9-4c6c-9216-9479712bf5ac roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19662024-11-22T04:02:25.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49076085-a8b9-4c6c-9216-9479712bf5ac resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19672024-11-22T04:02:25.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49076085-a8b9-4c6c-9216-9479712bf5ac response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19682024-11-22T04:02:26.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9704dab-42c4-41ba-b86f-2cf97572eff7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19692024-11-22T04:02:26.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9704dab-42c4-41ba-b86f-2cf97572eff7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19702024-11-22T04:02:26.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1899 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9704dab-42c4-41ba-b86f-2cf97572eff7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19712024-11-22T04:02:27.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d0660de-ded4-4ab0-ada3-4192c7bcb0c1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19722024-11-22T04:02:27.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d0660de-ded4-4ab0-ada3-4192c7bcb0c1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19732024-11-22T04:02:27.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2030 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d0660de-ded4-4ab0-ada3-4192c7bcb0c1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
19742024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
19752024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19762024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
19772024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
19782024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
19792024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19802024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
19812024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
19822024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
19832024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
19842024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19852024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
19862024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
19872024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19882024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
19892024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
19902024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19912024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
19922024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19932024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
19942024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19952024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
19962024-11-22T04:02:28.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
19972024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
19982024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19992024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20002024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
20012024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20022024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
20032024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20042024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
20052024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
20062024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
20072024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20082024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
20092024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20102024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
20112024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20122024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20132024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20142024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20152024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
20162024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20172024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20182024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20192024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20202024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20212024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20222024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20232024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20242024-11-22T04:02:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
20252024-11-22T04:02:28.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 792457344 } })
20262024-11-22T04:02:28.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
20272024-11-22T04:02:28.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 793181477 } })
20282024-11-22T04:02:28.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
20292024-11-22T04:02:28.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.901759ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
20302024-11-22T04:02:28.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20312024-11-22T04:02:28.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20322024-11-22T04:02:28.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20332024-11-22T04:02:28.444ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
20342024-11-22T04:02:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
20352024-11-22T04:02:28.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
20362024-11-22T04:02:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
20372024-11-22T04:02:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
20382024-11-22T04:02:28.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20392024-11-22T04:02:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
20402024-11-22T04:02:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20412024-11-22T04:02:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
20422024-11-22T04:02:28.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
20432024-11-22T04:02:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
20442024-11-22T04:02:28.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20452024-11-22T04:02:28.448ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20462024-11-22T04:02:28.448ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20472024-11-22T04:02:28.448ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
20482024-11-22T04:02:28.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20492024-11-22T04:02:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20502024-11-22T04:02:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
20512024-11-22T04:02:28.450ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20522024-11-22T04:02:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20532024-11-22T04:02:28.450ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20542024-11-22T04:02:28.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20552024-11-22T04:02:28.450ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
20562024-11-22T04:02:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20572024-11-22T04:02:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
20582024-11-22T04:02:28.451ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20592024-11-22T04:02:28.451ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20602024-11-22T04:02:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20612024-11-22T04:02:28.453ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1377, tv_nsec: 805126149 } })
20622024-11-22T04:02:28.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
20632024-11-22T04:02:28.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
20642024-11-22T04:02:28.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20652024-11-22T04:02:28.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20662024-11-22T04:02:28.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
20672024-11-22T04:02:28.459ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20682024-11-22T04:02:28.459ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20692024-11-22T04:02:28.459ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20702024-11-22T04:02:28.459ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20712024-11-22T04:02:28.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
20722024-11-22T04:02:28.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20732024-11-22T04:02:28.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20742024-11-22T04:02:28.462ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20752024-11-22T04:02:28.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20762024-11-22T04:02:28.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20772024-11-22T04:02:28.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20782024-11-22T04:02:28.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
20792024-11-22T04:02:28.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
20802024-11-22T04:02:28.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
20812024-11-22T04:02:28.468ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
20822024-11-22T04:02:28.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
20832024-11-22T04:02:28.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
20842024-11-22T04:02:28.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.934586ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
20852024-11-22T04:02:28.483ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
20862024-11-22T04:02:28.483ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 45.585919ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
20872024-11-22T04:02:28.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20882024-11-22T04:02:28.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20892024-11-22T04:02:28.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 52.841178ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
20902024-11-22T04:02:28.491ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
20912024-11-22T04:02:28.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
20922024-11-22T04:02:28.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 57.312666ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20932024-11-22T04:02:28.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 57.339488ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
20942024-11-22T04:02:28.495ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20952024-11-22T04:02:28.495ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20962024-11-22T04:02:28.495ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.536941ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20972024-11-22T04:02:28.496ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
20982024-11-22T04:02:28.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
20992024-11-22T04:02:28.499ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21002024-11-22T04:02:28.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
21012024-11-22T04:02:28.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
21022024-11-22T04:02:28.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
21032024-11-22T04:02:28.504ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
21042024-11-22T04:02:28.504ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.311247ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
21052024-11-22T04:02:28.533ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21062024-11-22T04:02:28.533ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21072024-11-22T04:02:28.533ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "24b5727c-2677-4ef5-b569-a00fd2536899", "content-length": "26", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21082024-11-22T04:02:28.533ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21092024-11-22T04:02:28.535ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21102024-11-22T04:02:28.537ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
21112024-11-22T04:02:28.537ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21122024-11-22T04:02:28.537ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "356534d0-e06e-4a9c-a33e-0efc3aed8dcd", "content-length": "26", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21132024-11-22T04:02:28.537ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21142024-11-22T04:02:28.539ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
21152024-11-22T04:02:28.556ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21162024-11-22T04:02:28.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21172024-11-22T04:02:28.565ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
21182024-11-22T04:02:28.565ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
21192024-11-22T04:02:28.565ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73bbdb6f-1442-4289-9eb7-9f53960a2a42", "content-length": "26", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21202024-11-22T04:02:28.565ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
21212024-11-22T04:02:28.566ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
21222024-11-22T04:02:28.635ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
21232024-11-22T04:02:28.635ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
21242024-11-22T04:02:28.646ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21252024-11-22T04:02:28.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21262024-11-22T04:02:28.646ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21272024-11-22T04:02:28.648ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21282024-11-22T04:02:28.652ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21292024-11-22T04:02:28.652ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21302024-11-22T04:02:28.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
21312024-11-22T04:02:28.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21322024-11-22T04:02:28.652ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
21332024-11-22T04:02:28.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
21342024-11-22T04:02:28.655ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.757193ms iteration = 16 status = {}
21352024-11-22T04:02:28.657ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
21362024-11-22T04:02:28.658ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 220.435492ms iteration = 16 status = 0
21372024-11-22T04:02:28.659ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
21382024-11-22T04:02:28.659ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
21392024-11-22T04:02:28.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
21402024-11-22T04:02:28.672ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
21412024-11-22T04:02:28.672ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5598b97-444c-44f6-95d5-5c227609c68e", "content-length": "1", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21422024-11-22T04:02:28.674ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
21432024-11-22T04:02:28.674ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
21442024-11-22T04:02:28.677ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 239.364617ms iteration = 16 status = null
21452024-11-22T04:02:28.689ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
21462024-11-22T04:02:28.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
21472024-11-22T04:02:28.697ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 259.052736ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
21482024-11-22T04:02:28.722ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 284.57566ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
21492024-11-22T04:02:28.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 279329f6-b136-4f57-b88d-a1241a5b0984 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
21502024-11-22T04:02:28.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 279329f6-b136-4f57-b88d-a1241a5b0984 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
21512024-11-22T04:02:28.744ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a5567e4-8aa1-4274-accd-f65e2a765a61", "content-length": "372", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21522024-11-22T04:02:28.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21532024-11-22T04:02:28.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21542024-11-22T04:02:28.758ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21552024-11-22T04:02:28.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21562024-11-22T04:02:28.759ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 321.492685ms iteration = 18 status = {"physical_disks_added":0}
21572024-11-22T04:02:28.779ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
21582024-11-22T04:02:28.780ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "409d5a31-bb47-42f8-92d2-ca1f581892cc", "content-length": "691", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21592024-11-22T04:02:28.780ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
21602024-11-22T04:02:28.780ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
21612024-11-22T04:02:28.780ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
21622024-11-22T04:02:28.781ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 343.582257ms iteration = 16 status = {}
21632024-11-22T04:02:28.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 279329f6-b136-4f57-b88d-a1241a5b0984 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
21642024-11-22T04:02:28.782ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
21652024-11-22T04:02:28.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21662024-11-22T04:02:28.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21672024-11-22T04:02:28.794ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
21682024-11-22T04:02:28.794ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "26ca9c2c-b09b-4c26-aa5a-7ddee11ea96e", "content-length": "134", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21692024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
21702024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
21712024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
21722024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
21732024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21742024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21752024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21762024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21772024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
21782024-11-22T04:02:28.794ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
21792024-11-22T04:02:28.795ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
21802024-11-22T04:02:28.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21812024-11-22T04:02:28.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21822024-11-22T04:02:28.797ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
21832024-11-22T04:02:28.797ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fcf1f1d-0574-4bd1-843a-1a06fdf7ab0b", "content-length": "2", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21842024-11-22T04:02:28.797ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
21852024-11-22T04:02:28.797ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "15857dad-b1c3-4a20-8bd0-7cf0e1e35a75", "content-length": "52", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21862024-11-22T04:02:28.797ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
21872024-11-22T04:02:28.797ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
21882024-11-22T04:02:28.823ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
21892024-11-22T04:02:28.823ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
21902024-11-22T04:02:28.884ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2a1af1ec-f92f-4d85-8b06-99248657e784", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21912024-11-22T04:02:28.884ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
21922024-11-22T04:02:28.884ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
21932024-11-22T04:02:28.885ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b1b34fcd-f2ad-4c70-b504-37db8499caad", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21942024-11-22T04:02:28.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
21952024-11-22T04:02:28.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
21962024-11-22T04:02:28.885ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a3e15c8-6fc2-4ab5-ab50-97ae5c2e5f0f", "content-length": "682", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
21972024-11-22T04:02:28.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
21982024-11-22T04:02:28.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
21992024-11-22T04:02:28.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22002024-11-22T04:02:28.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22012024-11-22T04:02:28.888ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22022024-11-22T04:02:28.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22032024-11-22T04:02:28.891ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
22042024-11-22T04:02:28.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
22052024-11-22T04:02:28.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22062024-11-22T04:02:28.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22072024-11-22T04:02:28.893ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
22082024-11-22T04:02:28.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
22092024-11-22T04:02:28.895ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
22102024-11-22T04:02:28.895ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
22112024-11-22T04:02:28.895ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bdfd1320-cd8b-46df-a4bc-3d30b2e4339a", "date": "Fri, 22 Nov 2024 04:02:28 GMT"} })
22122024-11-22T04:02:28.897ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 459.604295ms iteration = 16 status = {}
22132024-11-22T04:02:28.901ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 462.979725ms iteration = 16 status = {}
22142024-11-22T04:02:29.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f56429b1-9110-44b2-81b9-60ff805c7079 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
22152024-11-22T04:02:29.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f56429b1-9110-44b2-81b9-60ff805c7079 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
22162024-11-22T04:02:29.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f56429b1-9110-44b2-81b9-60ff805c7079 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
22172024-11-22T04:02:29.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6305688f-3ef3-4de8-86f8-942a632d28aa roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22182024-11-22T04:02:29.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6305688f-3ef3-4de8-86f8-942a632d28aa resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22192024-11-22T04:02:29.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6305688f-3ef3-4de8-86f8-942a632d28aa response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22202024-11-22T04:02:30.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 505 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 7ceaf341-626c-42e6-868b-5b819d219d50 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
22212024-11-22T04:02:30.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 996918e1-8828-46ea-ab32-b3f09e2b5391 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22222024-11-22T04:02:30.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 996918e1-8828-46ea-ab32-b3f09e2b5391 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22232024-11-22T04:02:30.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 996918e1-8828-46ea-ab32-b3f09e2b5391 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22242024-11-22T04:02:31.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 029aec6e-4622-408f-9d0a-bc5a0f732b1d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22252024-11-22T04:02:31.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 029aec6e-4622-408f-9d0a-bc5a0f732b1d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22262024-11-22T04:02:31.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 029aec6e-4622-408f-9d0a-bc5a0f732b1d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22272024-11-22T04:02:32.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2fd805ef-4b02-4451-90c1-0e4ca20da52f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22282024-11-22T04:02:32.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2fd805ef-4b02-4451-90c1-0e4ca20da52f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22292024-11-22T04:02:32.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2fd805ef-4b02-4451-90c1-0e4ca20da52f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22302024-11-22T04:02:33.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eabd96f7-2853-42de-bec4-dfd774ead300 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22312024-11-22T04:02:33.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eabd96f7-2853-42de-bec4-dfd774ead300 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22322024-11-22T04:02:33.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2264 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eabd96f7-2853-42de-bec4-dfd774ead300 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22332024-11-22T04:02:34.990ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18ff24ac-a9b5-4c75-aa07-29f7bb82783a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22342024-11-22T04:02:34.990ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18ff24ac-a9b5-4c75-aa07-29f7bb82783a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22352024-11-22T04:02:34.992ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18ff24ac-a9b5-4c75-aa07-29f7bb82783a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22362024-11-22T04:02:36.011ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 96825c70-dcae-4970-81ff-95a8f700d491 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22372024-11-22T04:02:36.011ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 96825c70-dcae-4970-81ff-95a8f700d491 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22382024-11-22T04:02:36.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 96825c70-dcae-4970-81ff-95a8f700d491 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22392024-11-22T04:02:37.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee794a8d-776e-43cf-bd5e-86741e19e47f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22402024-11-22T04:02:37.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee794a8d-776e-43cf-bd5e-86741e19e47f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22412024-11-22T04:02:37.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1675 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee794a8d-776e-43cf-bd5e-86741e19e47f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22422024-11-22T04:02:38.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 64540659-e3a8-4438-8914-e90d21be55da roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22432024-11-22T04:02:38.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 64540659-e3a8-4438-8914-e90d21be55da resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22442024-11-22T04:02:38.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 64540659-e3a8-4438-8914-e90d21be55da response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22452024-11-22T04:02:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
22462024-11-22T04:02:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
22472024-11-22T04:02:38.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22482024-11-22T04:02:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22492024-11-22T04:02:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22502024-11-22T04:02:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22512024-11-22T04:02:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22522024-11-22T04:02:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
22532024-11-22T04:02:38.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22542024-11-22T04:02:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22552024-11-22T04:02:38.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22562024-11-22T04:02:38.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22572024-11-22T04:02:38.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22582024-11-22T04:02:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
22592024-11-22T04:02:38.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
22602024-11-22T04:02:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
22612024-11-22T04:02:38.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
22622024-11-22T04:02:38.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.912169ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
22632024-11-22T04:02:38.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
22642024-11-22T04:02:38.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
22652024-11-22T04:02:38.495ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.023192ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
22662024-11-22T04:02:39.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 221c5047-b26b-452f-9e0c-85133fb6f68b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22672024-11-22T04:02:39.076ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 221c5047-b26b-452f-9e0c-85133fb6f68b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22682024-11-22T04:02:39.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1988 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 221c5047-b26b-452f-9e0c-85133fb6f68b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22692024-11-22T04:02:40.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d91ba64b-e53b-4286-a642-3c8ed5e31ca9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22702024-11-22T04:02:40.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d91ba64b-e53b-4286-a642-3c8ed5e31ca9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22712024-11-22T04:02:40.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d91ba64b-e53b-4286-a642-3c8ed5e31ca9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22722024-11-22T04:02:40.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 517 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 442684e9-2079-40f1-862e-19f9f8b90530 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
22732024-11-22T04:02:41.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e5b9d15-b619-4eda-8bae-f85e6710b399 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22742024-11-22T04:02:41.119ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e5b9d15-b619-4eda-8bae-f85e6710b399 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22752024-11-22T04:02:41.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1803 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e5b9d15-b619-4eda-8bae-f85e6710b399 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22762024-11-22T04:02:42.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 63ee38c7-551b-4e50-b2f5-bdbb991d49e3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22772024-11-22T04:02:42.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 63ee38c7-551b-4e50-b2f5-bdbb991d49e3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22782024-11-22T04:02:42.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2209 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 63ee38c7-551b-4e50-b2f5-bdbb991d49e3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22792024-11-22T04:02:43.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7dab84c0-0093-4359-86c7-0bacb413a7d6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22802024-11-22T04:02:43.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7dab84c0-0093-4359-86c7-0bacb413a7d6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22812024-11-22T04:02:43.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2449 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7dab84c0-0093-4359-86c7-0bacb413a7d6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22822024-11-22T04:02:44.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c44d2b9-b468-4f9f-a8a0-d059f19537c1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22832024-11-22T04:02:44.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c44d2b9-b468-4f9f-a8a0-d059f19537c1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22842024-11-22T04:02:44.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c44d2b9-b468-4f9f-a8a0-d059f19537c1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22852024-11-22T04:02:45.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b16e3a7d-ff4f-4d76-a226-3eaaa339ede3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22862024-11-22T04:02:45.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b16e3a7d-ff4f-4d76-a226-3eaaa339ede3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22872024-11-22T04:02:45.205ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1965 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b16e3a7d-ff4f-4d76-a226-3eaaa339ede3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22882024-11-22T04:02:46.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34927287-23b6-434a-ab86-ab8a82185d8b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22892024-11-22T04:02:46.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34927287-23b6-434a-ab86-ab8a82185d8b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22902024-11-22T04:02:46.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1480 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34927287-23b6-434a-ab86-ab8a82185d8b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22912024-11-22T04:02:47.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f0b024f0-46c8-451a-bcf4-1af85367b451 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22922024-11-22T04:02:47.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f0b024f0-46c8-451a-bcf4-1af85367b451 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22932024-11-22T04:02:47.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f0b024f0-46c8-451a-bcf4-1af85367b451 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22942024-11-22T04:02:48.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6a691e1-f3ca-450a-bc54-230629efcd25 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22952024-11-22T04:02:48.268ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6a691e1-f3ca-450a-bc54-230629efcd25 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22962024-11-22T04:02:48.270ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2130 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6a691e1-f3ca-450a-bc54-230629efcd25 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
22972024-11-22T04:02:48.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
22982024-11-22T04:02:48.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
22992024-11-22T04:02:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23002024-11-22T04:02:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23012024-11-22T04:02:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23022024-11-22T04:02:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23032024-11-22T04:02:48.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23042024-11-22T04:02:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
23052024-11-22T04:02:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23062024-11-22T04:02:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23072024-11-22T04:02:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23082024-11-22T04:02:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23092024-11-22T04:02:48.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23102024-11-22T04:02:48.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
23112024-11-22T04:02:48.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.225484ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
23122024-11-22T04:02:48.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23132024-11-22T04:02:48.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
23142024-11-22T04:02:48.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23152024-11-22T04:02:48.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
23162024-11-22T04:02:48.486ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
23172024-11-22T04:02:48.486ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.692794ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
23182024-11-22T04:02:49.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df24c83c-c16e-4f9a-858f-b21f9ed5cc75 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23192024-11-22T04:02:49.288ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df24c83c-c16e-4f9a-858f-b21f9ed5cc75 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23202024-11-22T04:02:49.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df24c83c-c16e-4f9a-858f-b21f9ed5cc75 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23212024-11-22T04:02:50.309ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d282d49e-2283-4a62-8e44-888e5e0ae0fe roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23222024-11-22T04:02:50.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d282d49e-2283-4a62-8e44-888e5e0ae0fe resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23232024-11-22T04:02:50.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1873 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d282d49e-2283-4a62-8e44-888e5e0ae0fe response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23242024-11-22T04:02:50.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 726 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 425f5f87-c0d7-4484-993a-bf8de6ad4296 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
23252024-11-22T04:02:51.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab6f1186-22e0-4558-87be-495b2935aae1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23262024-11-22T04:02:51.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab6f1186-22e0-4558-87be-495b2935aae1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23272024-11-22T04:02:51.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab6f1186-22e0-4558-87be-495b2935aae1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23282024-11-22T04:02:52.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24a26309-990b-4d2f-bc17-068647b7ebb9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23292024-11-22T04:02:52.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24a26309-990b-4d2f-bc17-068647b7ebb9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23302024-11-22T04:02:52.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2047 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24a26309-990b-4d2f-bc17-068647b7ebb9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23312024-11-22T04:02:53.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7e9a5e1a-7e96-4b94-a445-5163f3e3223c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23322024-11-22T04:02:53.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7e9a5e1a-7e96-4b94-a445-5163f3e3223c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23332024-11-22T04:02:53.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7e9a5e1a-7e96-4b94-a445-5163f3e3223c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23342024-11-22T04:02:54.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 643af135-2b73-44f3-8ec3-1addae81bff7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23352024-11-22T04:02:54.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 643af135-2b73-44f3-8ec3-1addae81bff7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23362024-11-22T04:02:54.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2194 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 643af135-2b73-44f3-8ec3-1addae81bff7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23372024-11-22T04:02:55.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 56e9ef5a-91c5-4203-b646-033312e0ec4c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23382024-11-22T04:02:55.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 56e9ef5a-91c5-4203-b646-033312e0ec4c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23392024-11-22T04:02:55.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1662 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 56e9ef5a-91c5-4203-b646-033312e0ec4c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23402024-11-22T04:02:56.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f2494b46-7502-4bde-a3e0-5dadf28c87b9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23412024-11-22T04:02:56.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f2494b46-7502-4bde-a3e0-5dadf28c87b9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23422024-11-22T04:02:56.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f2494b46-7502-4bde-a3e0-5dadf28c87b9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23432024-11-22T04:02:57.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3e456440-e8e7-4047-82e9-df9f8fdb221d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23442024-11-22T04:02:57.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3e456440-e8e7-4047-82e9-df9f8fdb221d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23452024-11-22T04:02:57.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3e456440-e8e7-4047-82e9-df9f8fdb221d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
23462024-11-22T04:02:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
23472024-11-22T04:02:58.436ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
23482024-11-22T04:02:58.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23492024-11-22T04:02:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
23502024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23512024-11-22T04:02:58.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 788818800 } })
23522024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
23532024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
23542024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
23552024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
23562024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
23572024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
23582024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
23592024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
23602024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
23612024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
23622024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
23632024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
23642024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
23652024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
23662024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
23672024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
23682024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
23692024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
23702024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
23712024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
23722024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
23732024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
23742024-11-22T04:02:58.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
23752024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
23762024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
23772024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
23782024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
23792024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23802024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
23812024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
23822024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
23832024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
23842024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
23852024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
23862024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
23872024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
23882024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
23892024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
23902024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23912024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
23922024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
23932024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
23942024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23952024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
23962024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
23972024-11-22T04:02:58.437ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
23982024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
23992024-11-22T04:02:58.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
24002024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24012024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
24022024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.09\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
24032024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
24042024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
24052024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
24062024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
24072024-11-22T04:02:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
24082024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24092024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
24102024-11-22T04:02:58.438ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:52:58.437940655 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
24112024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
24122024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
24132024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
24142024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
24152024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
24162024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
24172024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24182024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24192024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24202024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
24212024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24222024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24232024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24242024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
24252024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
24262024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.513437ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
24272024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
24282024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
24292024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24302024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24312024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24322024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
24332024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
24342024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
24352024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
24362024-11-22T04:02:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 789918979 } })
24372024-11-22T04:02:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
24382024-11-22T04:02:58.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
24392024-11-22T04:02:58.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.10429ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
24402024-11-22T04:02:58.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 792795770 } })
24412024-11-22T04:02:58.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
24422024-11-22T04:02:58.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.844406ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
24432024-11-22T04:02:58.442ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 5.295734ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
24442024-11-22T04:02:58.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24452024-11-22T04:02:58.444ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
24462024-11-22T04:02:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
24472024-11-22T04:02:58.445ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
24482024-11-22T04:02:58.445ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
24492024-11-22T04:02:58.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
24502024-11-22T04:02:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
24512024-11-22T04:02:58.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24522024-11-22T04:02:58.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24532024-11-22T04:02:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24542024-11-22T04:02:58.447ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24552024-11-22T04:02:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24562024-11-22T04:02:58.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
24572024-11-22T04:02:58.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24582024-11-22T04:02:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
24592024-11-22T04:02:58.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
24602024-11-22T04:02:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24612024-11-22T04:02:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
24622024-11-22T04:02:58.452ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24632024-11-22T04:02:58.454ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24642024-11-22T04:02:58.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
24652024-11-22T04:02:58.454ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
24662024-11-22T04:02:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
24672024-11-22T04:02:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
24682024-11-22T04:02:58.456ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
24692024-11-22T04:02:58.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24702024-11-22T04:02:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
24712024-11-22T04:02:58.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
24722024-11-22T04:02:58.458ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24732024-11-22T04:02:58.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24742024-11-22T04:02:58.461ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 812780495 } })
24752024-11-22T04:02:58.461ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
24762024-11-22T04:02:58.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24772024-11-22T04:02:58.462ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:52:58.437940655 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
24782024-11-22T04:02:58.462ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 24.592836ms iteration = 9 status = {"expiration":"2024-11-22T03:52:58.437940655Z","pruned":[]}
24792024-11-22T04:02:58.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24802024-11-22T04:02:58.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24812024-11-22T04:02:58.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
24822024-11-22T04:02:58.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
24832024-11-22T04:02:58.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
24842024-11-22T04:02:58.467ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1407, tv_nsec: 818966524 } })
24852024-11-22T04:02:58.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24862024-11-22T04:02:58.467ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
24872024-11-22T04:02:58.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24882024-11-22T04:02:58.468ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24892024-11-22T04:02:58.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24902024-11-22T04:02:58.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24912024-11-22T04:02:58.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24922024-11-22T04:02:58.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24932024-11-22T04:02:58.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
24942024-11-22T04:02:58.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
24952024-11-22T04:02:58.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
24962024-11-22T04:02:58.477ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 39.903459ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
24972024-11-22T04:02:58.480ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
24982024-11-22T04:02:58.480ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
24992024-11-22T04:02:58.480ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 42.569125ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
25002024-11-22T04:02:58.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c1ab6cef-77ec-4c1d-9d2f-391dd10b60f8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
25012024-11-22T04:02:58.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c1ab6cef-77ec-4c1d-9d2f-391dd10b60f8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
25022024-11-22T04:02:58.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2155 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c1ab6cef-77ec-4c1d-9d2f-391dd10b60f8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
25032024-11-22T04:02:58.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25042024-11-22T04:02:58.488ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25052024-11-22T04:02:58.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25062024-11-22T04:02:58.489ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
25072024-11-22T04:02:58.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25082024-11-22T04:02:58.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25092024-11-22T04:02:58.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25102024-11-22T04:02:58.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
25112024-11-22T04:02:58.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25122024-11-22T04:02:58.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25132024-11-22T04:02:58.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.831903ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
25142024-11-22T04:02:58.493ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
25152024-11-22T04:02:58.493ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.695688ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
25162024-11-22T04:02:58.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
25172024-11-22T04:02:58.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25182024-11-22T04:02:58.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25192024-11-22T04:02:58.496ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
25202024-11-22T04:02:58.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25212024-11-22T04:02:58.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25222024-11-22T04:02:58.497ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25232024-11-22T04:02:58.497ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
25242024-11-22T04:02:58.497ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
25252024-11-22T04:02:58.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
25262024-11-22T04:02:58.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.987143ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
25272024-11-22T04:02:58.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25282024-11-22T04:02:58.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25292024-11-22T04:02:58.501ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
25302024-11-22T04:02:58.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
25312024-11-22T04:02:58.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25322024-11-22T04:02:58.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25332024-11-22T04:02:58.516ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25342024-11-22T04:02:58.517ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
25352024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
25362024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
25372024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25382024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
25392024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
25402024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
25412024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25422024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25432024-11-22T04:02:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25442024-11-22T04:02:58.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
25452024-11-22T04:02:58.519ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25462024-11-22T04:02:58.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25472024-11-22T04:02:58.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25482024-11-22T04:02:58.519ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
25492024-11-22T04:02:58.519ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
25502024-11-22T04:02:58.519ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.013345ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
25512024-11-22T04:02:58.520ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
25522024-11-22T04:02:58.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
25532024-11-22T04:02:58.521ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25542024-11-22T04:02:58.523ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.612619ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
25552024-11-22T04:02:58.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
25562024-11-22T04:02:58.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25572024-11-22T04:02:58.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25582024-11-22T04:02:58.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
25592024-11-22T04:02:58.525ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25602024-11-22T04:02:58.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25612024-11-22T04:02:58.525ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
25622024-11-22T04:02:58.525ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.882689ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
25632024-11-22T04:02:58.536ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
25642024-11-22T04:02:58.536ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
25652024-11-22T04:02:58.536ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.030717ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
25662024-11-22T04:02:58.537ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25672024-11-22T04:02:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25682024-11-22T04:02:58.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25692024-11-22T04:02:58.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25702024-11-22T04:02:58.542ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25712024-11-22T04:02:58.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
25722024-11-22T04:02:58.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
25732024-11-22T04:02:58.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
25742024-11-22T04:02:58.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
25752024-11-22T04:02:58.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
25762024-11-22T04:02:58.548ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.722205ms iteration = 17 status = 0
25772024-11-22T04:02:58.551ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
25782024-11-22T04:02:58.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
25792024-11-22T04:02:58.554ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25802024-11-22T04:02:58.554ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25812024-11-22T04:02:58.558ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
25822024-11-22T04:02:58.558ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
25832024-11-22T04:02:58.558ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
25842024-11-22T04:02:58.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
25852024-11-22T04:02:58.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 120.62369ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
25862024-11-22T04:02:58.563ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
25872024-11-22T04:02:58.563ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25882024-11-22T04:02:58.563ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bcb3596-5600-4f70-af2b-7c75d8b78d19", "content-length": "26", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
25892024-11-22T04:02:58.563ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25902024-11-22T04:02:58.565ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25912024-11-22T04:02:58.566ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
25922024-11-22T04:02:58.566ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
25932024-11-22T04:02:58.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
25942024-11-22T04:02:58.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
25952024-11-22T04:02:58.568ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
25962024-11-22T04:02:58.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
25972024-11-22T04:02:58.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25982024-11-22T04:02:58.570ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25992024-11-22T04:02:58.572ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
26002024-11-22T04:02:58.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
26012024-11-22T04:02:58.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
26022024-11-22T04:02:58.573ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
26032024-11-22T04:02:58.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
26042024-11-22T04:02:58.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
26052024-11-22T04:02:58.575ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
26062024-11-22T04:02:58.575ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26072024-11-22T04:02:58.575ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
26082024-11-22T04:02:58.575ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 137.247275ms iteration = 9 status = {"generation":2}
26092024-11-22T04:02:58.577ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
26102024-11-22T04:02:58.577ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26112024-11-22T04:02:58.577ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "54188358-8766-4e4c-b64a-e8619220b65f", "content-length": "26", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
26122024-11-22T04:02:58.577ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26132024-11-22T04:02:58.579ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
26142024-11-22T04:02:58.585ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
26152024-11-22T04:02:58.585ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
26162024-11-22T04:02:58.585ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7feaa483-56dd-4da9-8568-294483bd3f67", "content-length": "26", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
26172024-11-22T04:02:58.585ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
26182024-11-22T04:02:58.585ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.2382ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
26192024-11-22T04:02:58.586ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
26202024-11-22T04:02:58.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212024-11-22T04:02:58.595ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26222024-11-22T04:02:58.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26232024-11-22T04:02:58.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
26242024-11-22T04:02:58.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
26252024-11-22T04:02:58.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
26262024-11-22T04:02:58.600ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
26272024-11-22T04:02:58.600ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
26282024-11-22T04:02:58.600ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
26292024-11-22T04:02:58.600ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 163.668584ms iteration = 9 status = {"generation":1}
26302024-11-22T04:02:58.607ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.709111ms iteration = 19 status = {"physical_disks_added":0}
26312024-11-22T04:02:58.612ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
26322024-11-22T04:02:58.612ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 174.625489ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
26332024-11-22T04:02:58.631ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) }
26342024-11-22T04:02:58.631ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 194.031393ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
26352024-11-22T04:02:58.738ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
26362024-11-22T04:02:58.738ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2ed851b3-5537-4737-9f5a-81daabbbdc78", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26372024-11-22T04:02:58.738ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26382024-11-22T04:02:58.739ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "09ca8694-b41f-482e-9fd2-022719cd6b83", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26392024-11-22T04:02:58.739ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26402024-11-22T04:02:58.739ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
26412024-11-22T04:02:58.740ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4059a46b-3838-4dd0-82fc-f4c7425778f7", "content-length": "1", "date": "Fri, 22 Nov 2024 04:02:57 GMT"} })
26422024-11-22T04:02:58.741ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
26432024-11-22T04:02:58.741ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 304.284939ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
26442024-11-22T04:02:58.742ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
26452024-11-22T04:02:58.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
26462024-11-22T04:02:58.744ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 307.276643ms iteration = 17 status = null
26472024-11-22T04:02:58.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26482024-11-22T04:02:58.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26492024-11-22T04:02:58.755ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26502024-11-22T04:02:58.758ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26512024-11-22T04:02:58.758ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26522024-11-22T04:02:58.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26532024-11-22T04:02:58.758ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26542024-11-22T04:02:58.758ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26552024-11-22T04:02:58.759ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5608f398-370b-4bce-ac61-33f45d9b60fb", "content-length": "372", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
26562024-11-22T04:02:58.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26572024-11-22T04:02:58.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26582024-11-22T04:02:58.792ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 354.637602ms iteration = 17 status = {}
26592024-11-22T04:02:58.800ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26602024-11-22T04:02:58.801ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
26612024-11-22T04:02:58.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
26622024-11-22T04:02:58.803ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
26632024-11-22T04:02:58.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
26642024-11-22T04:02:58.817ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26652024-11-22T04:02:58.817ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26662024-11-22T04:02:58.817ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ce29c637-f9ad-424d-ba52-27e8751c75aa", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
26672024-11-22T04:02:58.817ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26682024-11-22T04:02:58.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26692024-11-22T04:02:58.819ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26702024-11-22T04:02:58.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26712024-11-22T04:02:58.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26722024-11-22T04:02:58.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26732024-11-22T04:02:58.826ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26742024-11-22T04:02:58.826ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26752024-11-22T04:02:58.868ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
26762024-11-22T04:02:58.868ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "50b60eeb-312e-498c-85ee-e4f934196324", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26772024-11-22T04:02:58.868ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26782024-11-22T04:02:58.869ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f0c67bdc-fce0-4b5b-b559-5b08b1b111cb", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26792024-11-22T04:02:58.869ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26802024-11-22T04:02:58.871ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "941fcca9-f181-4c0b-b498-897fd329b07c", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26812024-11-22T04:02:58.871ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26822024-11-22T04:02:58.872ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
26832024-11-22T04:02:58.872ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 435.023258ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
26842024-11-22T04:02:58.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26852024-11-22T04:02:58.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26862024-11-22T04:02:58.892ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
26872024-11-22T04:02:58.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
26882024-11-22T04:02:58.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
26892024-11-22T04:02:58.908ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26902024-11-22T04:02:58.915ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c6b80d1-cf89-458c-996a-22e31dab645b", "content-length": "691", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
26912024-11-22T04:02:58.915ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26922024-11-22T04:02:58.915ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26932024-11-22T04:02:58.915ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26942024-11-22T04:02:58.915ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3a57d8e7-184e-4807-9d8f-ebbdb843bba8", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
26952024-11-22T04:02:58.916ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 479.227403ms iteration = 17 status = {}
26962024-11-22T04:02:58.917ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 479.372126ms iteration = 17 status = {}
26972024-11-22T04:02:58.918ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
26982024-11-22T04:02:58.918ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d8e45e7-6d54-4eba-acea-6fbbaf5ce2b9", "content-length": "134", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
26992024-11-22T04:02:58.918ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27002024-11-22T04:02:58.918ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
27012024-11-22T04:02:58.918ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27022024-11-22T04:02:58.918ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27032024-11-22T04:02:58.918ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27042024-11-22T04:02:58.918ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27052024-11-22T04:02:58.918ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27062024-11-22T04:02:58.918ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27072024-11-22T04:02:58.919ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27082024-11-22T04:02:58.919ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27092024-11-22T04:02:58.919ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
27102024-11-22T04:02:58.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27112024-11-22T04:02:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27122024-11-22T04:02:58.921ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
27132024-11-22T04:02:58.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e006cb46-8cb4-4920-823b-e6aa2c157e69", "content-length": "2", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
27142024-11-22T04:02:58.922ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
27152024-11-22T04:02:58.922ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5483842-5a35-44ac-b2c5-906ee74b40fe", "content-length": "52", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
27162024-11-22T04:02:58.922ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
27172024-11-22T04:02:58.922ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27182024-11-22T04:02:59.021ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5073cb1d-8929-4400-94fa-037e1c6251ae", "date": "Fri, 22 Nov 2024 04:02:58 GMT"} })
27192024-11-22T04:02:59.021ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
27202024-11-22T04:02:59.021ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27212024-11-22T04:02:59.022ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e36d86c-7265-407a-a9ce-fd2c6f338cef", "content-length": "682", "date": "Fri, 22 Nov 2024 04:02:59 GMT"} })
27222024-11-22T04:02:59.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27232024-11-22T04:02:59.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27242024-11-22T04:02:59.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27252024-11-22T04:02:59.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27262024-11-22T04:02:59.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27272024-11-22T04:02:59.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27282024-11-22T04:02:59.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27292024-11-22T04:02:59.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27302024-11-22T04:02:59.039ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 601.600035ms iteration = 17 status = {}
27312024-11-22T04:02:59.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 1a4ecd01-8650-4726-81a8-2e0918ebb101 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
27322024-11-22T04:02:59.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 1a4ecd01-8650-4726-81a8-2e0918ebb101 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
27332024-11-22T04:02:59.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3182 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 1a4ecd01-8650-4726-81a8-2e0918ebb101 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
27342024-11-22T04:02:59.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d7691175-659c-46fa-9959-9a5f4511f680 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27352024-11-22T04:02:59.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d7691175-659c-46fa-9959-9a5f4511f680 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27362024-11-22T04:02:59.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d7691175-659c-46fa-9959-9a5f4511f680 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27372024-11-22T04:03:00.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b733439-a14c-48b8-b5a9-5eb0b3bc186c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27382024-11-22T04:03:00.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b733439-a14c-48b8-b5a9-5eb0b3bc186c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27392024-11-22T04:03:00.534ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1943 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b733439-a14c-48b8-b5a9-5eb0b3bc186c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27402024-11-22T04:03:00.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 572 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 8bb44368-38eb-409e-8b6a-44b5790f3923 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
27412024-11-22T04:03:01.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2e0ba3c8-aeaa-4d75-89ea-ca57e91cfd1d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27422024-11-22T04:03:01.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2e0ba3c8-aeaa-4d75-89ea-ca57e91cfd1d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27432024-11-22T04:03:01.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2197 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2e0ba3c8-aeaa-4d75-89ea-ca57e91cfd1d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27442024-11-22T04:03:02.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fd0d7882-402a-4ed6-99c7-52902fe2610a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27452024-11-22T04:03:02.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fd0d7882-402a-4ed6-99c7-52902fe2610a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27462024-11-22T04:03:02.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fd0d7882-402a-4ed6-99c7-52902fe2610a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27472024-11-22T04:03:03.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d40234ab-a044-43b8-8468-305b5dfac4af roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27482024-11-22T04:03:03.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d40234ab-a044-43b8-8468-305b5dfac4af resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27492024-11-22T04:03:03.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1526 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d40234ab-a044-43b8-8468-305b5dfac4af response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27502024-11-22T04:03:04.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 55da78c8-acb3-47a7-bfb5-6a4218ee0c2c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27512024-11-22T04:03:04.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 55da78c8-acb3-47a7-bfb5-6a4218ee0c2c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27522024-11-22T04:03:04.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 55da78c8-acb3-47a7-bfb5-6a4218ee0c2c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27532024-11-22T04:03:05.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8458d30a-bc49-4120-9179-a20623ba07ec roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27542024-11-22T04:03:05.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8458d30a-bc49-4120-9179-a20623ba07ec resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27552024-11-22T04:03:05.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8458d30a-bc49-4120-9179-a20623ba07ec response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27562024-11-22T04:03:06.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95513bd7-6c5d-46ee-8e6c-bcdf34609838 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27572024-11-22T04:03:06.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95513bd7-6c5d-46ee-8e6c-bcdf34609838 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27582024-11-22T04:03:06.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95513bd7-6c5d-46ee-8e6c-bcdf34609838 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27592024-11-22T04:03:07.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 62ace1b2-9004-4747-b8cf-83656ac8fc9e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27602024-11-22T04:03:07.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 62ace1b2-9004-4747-b8cf-83656ac8fc9e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27612024-11-22T04:03:07.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 62ace1b2-9004-4747-b8cf-83656ac8fc9e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27622024-11-22T04:03:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
27632024-11-22T04:03:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
27642024-11-22T04:03:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27652024-11-22T04:03:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27662024-11-22T04:03:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27672024-11-22T04:03:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27682024-11-22T04:03:08.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27692024-11-22T04:03:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27702024-11-22T04:03:08.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27712024-11-22T04:03:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.37244ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27722024-11-22T04:03:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27732024-11-22T04:03:08.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27742024-11-22T04:03:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27752024-11-22T04:03:08.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27762024-11-22T04:03:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27772024-11-22T04:03:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27782024-11-22T04:03:08.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
27792024-11-22T04:03:08.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27802024-11-22T04:03:08.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27812024-11-22T04:03:08.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
27822024-11-22T04:03:08.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.928977ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
27832024-11-22T04:03:08.701ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ed763b27-5485-4f8e-a06b-014012163b23 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27842024-11-22T04:03:08.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ed763b27-5485-4f8e-a06b-014012163b23 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27852024-11-22T04:03:08.703ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1768 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ed763b27-5485-4f8e-a06b-014012163b23 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27862024-11-22T04:03:09.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f37280f2-539d-43e8-9581-9be46c8e813c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27872024-11-22T04:03:09.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f37280f2-539d-43e8-9581-9be46c8e813c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27882024-11-22T04:03:09.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1815 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f37280f2-539d-43e8-9581-9be46c8e813c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27892024-11-22T04:03:10.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = fee6482e-780b-4569-a36a-d7c14d8668a7 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
27902024-11-22T04:03:10.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e566d0a-6725-41be-b036-95a568b07e73 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27912024-11-22T04:03:10.743ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e566d0a-6725-41be-b036-95a568b07e73 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27922024-11-22T04:03:10.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e566d0a-6725-41be-b036-95a568b07e73 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27932024-11-22T04:03:11.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e08a11d-9cc2-4757-8cf6-3ec7e5447651 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27942024-11-22T04:03:11.764ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e08a11d-9cc2-4757-8cf6-3ec7e5447651 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27952024-11-22T04:03:11.766ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e08a11d-9cc2-4757-8cf6-3ec7e5447651 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27962024-11-22T04:03:12.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ec97913-b338-47d7-95c6-c1ff6801e4e9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27972024-11-22T04:03:12.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ec97913-b338-47d7-95c6-c1ff6801e4e9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27982024-11-22T04:03:12.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1957 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ec97913-b338-47d7-95c6-c1ff6801e4e9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
27992024-11-22T04:03:13.805ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43905dd9-3ec3-4088-b886-b3bb18e5e0de roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28002024-11-22T04:03:13.805ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43905dd9-3ec3-4088-b886-b3bb18e5e0de resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28012024-11-22T04:03:13.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1814 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43905dd9-3ec3-4088-b886-b3bb18e5e0de response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28022024-11-22T04:03:14.826ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 695c33c4-a168-4c71-b024-33f5d35dd2df roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28032024-11-22T04:03:14.827ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 695c33c4-a168-4c71-b024-33f5d35dd2df resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28042024-11-22T04:03:14.828ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2110 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 695c33c4-a168-4c71-b024-33f5d35dd2df response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28052024-11-22T04:03:15.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = da9eb4b3-ce76-4b46-95f5-2db1efa4f921 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28062024-11-22T04:03:15.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = da9eb4b3-ce76-4b46-95f5-2db1efa4f921 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28072024-11-22T04:03:15.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2816 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = da9eb4b3-ce76-4b46-95f5-2db1efa4f921 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28082024-11-22T04:03:16.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 329eee2b-5f75-40cb-9f05-f235a891a0ec roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28092024-11-22T04:03:16.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 329eee2b-5f75-40cb-9f05-f235a891a0ec resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28102024-11-22T04:03:16.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1927 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 329eee2b-5f75-40cb-9f05-f235a891a0ec response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28112024-11-22T04:03:17.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e4774073-fd4a-4a69-958f-48bb522ee393 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28122024-11-22T04:03:17.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e4774073-fd4a-4a69-958f-48bb522ee393 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28132024-11-22T04:03:17.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e4774073-fd4a-4a69-958f-48bb522ee393 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28142024-11-22T04:03:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
28152024-11-22T04:03:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
28162024-11-22T04:03:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28172024-11-22T04:03:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28182024-11-22T04:03:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28192024-11-22T04:03:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28202024-11-22T04:03:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28212024-11-22T04:03:18.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28222024-11-22T04:03:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28232024-11-22T04:03:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28242024-11-22T04:03:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28252024-11-22T04:03:18.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.717764ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28262024-11-22T04:03:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28272024-11-22T04:03:18.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28282024-11-22T04:03:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28292024-11-22T04:03:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28302024-11-22T04:03:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
28312024-11-22T04:03:18.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28322024-11-22T04:03:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28332024-11-22T04:03:18.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
28342024-11-22T04:03:18.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.293503ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
28352024-11-22T04:03:18.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 380939a6-1eb7-41a3-b92f-aa49670593f7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28362024-11-22T04:03:18.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 380939a6-1eb7-41a3-b92f-aa49670593f7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28372024-11-22T04:03:18.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 380939a6-1eb7-41a3-b92f-aa49670593f7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28382024-11-22T04:03:19.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9a0bbc75-0a0f-41cb-aa7b-722d2880999d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28392024-11-22T04:03:19.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9a0bbc75-0a0f-41cb-aa7b-722d2880999d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28402024-11-22T04:03:19.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2094 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9a0bbc75-0a0f-41cb-aa7b-722d2880999d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28412024-11-22T04:03:20.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 932 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 3ace6ab7-af45-45c9-8acf-9f7946ddd380 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
28422024-11-22T04:03:20.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d6f2eb7-a659-4021-83a6-01952d6cd5fa roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28432024-11-22T04:03:20.953ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d6f2eb7-a659-4021-83a6-01952d6cd5fa resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28442024-11-22T04:03:20.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2036 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d6f2eb7-a659-4021-83a6-01952d6cd5fa response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28452024-11-22T04:03:21.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43fbb178-3aa9-4300-b342-97416942959a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28462024-11-22T04:03:21.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43fbb178-3aa9-4300-b342-97416942959a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28472024-11-22T04:03:21.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2098 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43fbb178-3aa9-4300-b342-97416942959a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28482024-11-22T04:03:22.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c06b5efa-62a3-40ed-bc0c-328f84877949 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28492024-11-22T04:03:22.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c06b5efa-62a3-40ed-bc0c-328f84877949 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28502024-11-22T04:03:22.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2443 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c06b5efa-62a3-40ed-bc0c-328f84877949 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28512024-11-22T04:03:24.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98a94047-e3ee-475f-bdac-3177c7e07903 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28522024-11-22T04:03:24.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98a94047-e3ee-475f-bdac-3177c7e07903 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28532024-11-22T04:03:24.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98a94047-e3ee-475f-bdac-3177c7e07903 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28542024-11-22T04:03:25.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1f1c69b7-be83-4504-927e-b9237bef2587 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28552024-11-22T04:03:25.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1f1c69b7-be83-4504-927e-b9237bef2587 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28562024-11-22T04:03:25.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1f1c69b7-be83-4504-927e-b9237bef2587 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28572024-11-22T04:03:26.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7bfa18c1-ee95-4d95-bb97-f33d490e8fa2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28582024-11-22T04:03:26.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7bfa18c1-ee95-4d95-bb97-f33d490e8fa2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28592024-11-22T04:03:26.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2248 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7bfa18c1-ee95-4d95-bb97-f33d490e8fa2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28602024-11-22T04:03:27.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1bc10132-1e54-4a35-a740-128549fb77dd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28612024-11-22T04:03:27.080ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1bc10132-1e54-4a35-a740-128549fb77dd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28622024-11-22T04:03:27.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1749 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1bc10132-1e54-4a35-a740-128549fb77dd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28632024-11-22T04:03:28.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14e41600-4dcf-4c37-9968-2aa28e702917 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28642024-11-22T04:03:28.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14e41600-4dcf-4c37-9968-2aa28e702917 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28652024-11-22T04:03:28.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14e41600-4dcf-4c37-9968-2aa28e702917 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
28662024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
28672024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
28682024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
28692024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
28702024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
28712024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
28722024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
28732024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
28742024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
28752024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
28762024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
28772024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28782024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
28792024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28802024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
28812024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
28822024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28832024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
28842024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
28852024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
28862024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
28872024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
28882024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
28892024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28902024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28912024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28922024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
28932024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
28942024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28952024-11-22T04:03:28.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
28962024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28972024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
28982024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
28992024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29002024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29012024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29022024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29032024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29042024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29052024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29062024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29072024-11-22T04:03:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29082024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29092024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29102024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29112024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29122024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29132024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29142024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29152024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29162024-11-22T04:03:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29172024-11-22T04:03:28.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.046625ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
29182024-11-22T04:03:28.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.39105ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29192024-11-22T04:03:28.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29202024-11-22T04:03:28.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 794141394 } })
29212024-11-22T04:03:28.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
29222024-11-22T04:03:28.444ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 795374236 } })
29232024-11-22T04:03:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29242024-11-22T04:03:28.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29252024-11-22T04:03:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29262024-11-22T04:03:28.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
29272024-11-22T04:03:28.446ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.004102ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
29282024-11-22T04:03:28.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29292024-11-22T04:03:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29302024-11-22T04:03:28.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29312024-11-22T04:03:28.447ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29322024-11-22T04:03:28.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29332024-11-22T04:03:28.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29342024-11-22T04:03:28.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29352024-11-22T04:03:28.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29362024-11-22T04:03:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29372024-11-22T04:03:28.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29382024-11-22T04:03:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29392024-11-22T04:03:28.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29402024-11-22T04:03:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29412024-11-22T04:03:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29422024-11-22T04:03:28.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29432024-11-22T04:03:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29442024-11-22T04:03:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29452024-11-22T04:03:28.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29462024-11-22T04:03:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29472024-11-22T04:03:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29482024-11-22T04:03:28.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29492024-11-22T04:03:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29502024-11-22T04:03:28.454ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1437, tv_nsec: 805691059 } })
29512024-11-22T04:03:28.454ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
29522024-11-22T04:03:28.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29532024-11-22T04:03:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29542024-11-22T04:03:28.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29552024-11-22T04:03:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29562024-11-22T04:03:28.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29572024-11-22T04:03:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29582024-11-22T04:03:28.475ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29592024-11-22T04:03:28.475ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
29602024-11-22T04:03:28.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29612024-11-22T04:03:28.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29622024-11-22T04:03:28.479ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29632024-11-22T04:03:28.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29642024-11-22T04:03:28.481ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
29652024-11-22T04:03:28.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29662024-11-22T04:03:28.482ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29672024-11-22T04:03:28.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29682024-11-22T04:03:28.483ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29692024-11-22T04:03:28.484ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29702024-11-22T04:03:28.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29712024-11-22T04:03:28.486ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
29722024-11-22T04:03:28.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29732024-11-22T04:03:28.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29742024-11-22T04:03:28.487ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 49.159913ms iteration = 18 status = 0
29752024-11-22T04:03:28.487ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29762024-11-22T04:03:28.487ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 49.479758ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29772024-11-22T04:03:28.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29782024-11-22T04:03:28.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29792024-11-22T04:03:28.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29802024-11-22T04:03:28.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.897031ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
29812024-11-22T04:03:28.491ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29822024-11-22T04:03:28.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
29832024-11-22T04:03:28.495ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29842024-11-22T04:03:28.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29852024-11-22T04:03:28.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29862024-11-22T04:03:28.498ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29872024-11-22T04:03:28.498ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29882024-11-22T04:03:28.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29892024-11-22T04:03:28.499ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
29902024-11-22T04:03:28.499ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 61.071784ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
29912024-11-22T04:03:28.502ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
29922024-11-22T04:03:28.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29932024-11-22T04:03:28.510ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 72.306323ms iteration = 20 status = {"physical_disks_added":0}
29942024-11-22T04:03:28.510ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
29952024-11-22T04:03:28.510ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.413074ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
29962024-11-22T04:03:28.515ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29972024-11-22T04:03:28.515ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
29982024-11-22T04:03:28.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29992024-11-22T04:03:28.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30002024-11-22T04:03:28.521ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 82.876711ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
30012024-11-22T04:03:28.524ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.837813ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
30022024-11-22T04:03:28.527ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30032024-11-22T04:03:28.529ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
30042024-11-22T04:03:28.529ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30052024-11-22T04:03:28.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30062024-11-22T04:03:28.531ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30072024-11-22T04:03:28.531ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30082024-11-22T04:03:28.531ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "48d5599e-5229-4b7c-b9c6-9808657a3273", "content-length": "26", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30092024-11-22T04:03:28.531ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30102024-11-22T04:03:28.532ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30112024-11-22T04:03:28.539ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
30122024-11-22T04:03:28.539ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30132024-11-22T04:03:28.539ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd8d41cd-d437-4018-b2bd-524ce8df60ab", "content-length": "26", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30142024-11-22T04:03:28.539ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30152024-11-22T04:03:28.542ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30162024-11-22T04:03:28.550ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
30172024-11-22T04:03:28.550ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30182024-11-22T04:03:28.550ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbd3d97a-21ba-4e32-85ca-b9f6ce663c19", "content-length": "26", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30192024-11-22T04:03:28.550ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30202024-11-22T04:03:28.552ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
30212024-11-22T04:03:28.552ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30222024-11-22T04:03:28.552ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30232024-11-22T04:03:28.552ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.321848ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30242024-11-22T04:03:28.594ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30252024-11-22T04:03:28.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30262024-11-22T04:03:28.596ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30272024-11-22T04:03:28.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30282024-11-22T04:03:28.598ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30292024-11-22T04:03:28.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30302024-11-22T04:03:28.730ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30312024-11-22T04:03:28.730ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30322024-11-22T04:03:28.730ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "70dddf64-b7ca-4038-b82c-db4f8df30589", "content-length": "372", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30332024-11-22T04:03:28.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30342024-11-22T04:03:28.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30352024-11-22T04:03:28.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30362024-11-22T04:03:28.734ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
30372024-11-22T04:03:28.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30382024-11-22T04:03:28.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30392024-11-22T04:03:28.755ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
30402024-11-22T04:03:28.755ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d673fef7-96cc-4efb-b8af-af8f1b14dd6b", "content-length": "1", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30412024-11-22T04:03:28.757ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30422024-11-22T04:03:28.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30432024-11-22T04:03:28.759ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 320.858202ms iteration = 18 status = null
30442024-11-22T04:03:28.764ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.074485ms iteration = 18 status = {}
30452024-11-22T04:03:28.777ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
30462024-11-22T04:03:28.777ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30472024-11-22T04:03:28.777ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "8de8bb09-d48f-48a9-a6f1-4aafba517a6e", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30482024-11-22T04:03:28.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30492024-11-22T04:03:28.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30502024-11-22T04:03:28.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30512024-11-22T04:03:28.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30522024-11-22T04:03:28.783ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30532024-11-22T04:03:28.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30542024-11-22T04:03:28.789ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30552024-11-22T04:03:28.789ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30562024-11-22T04:03:28.789ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d710612c-b3b9-425d-a77f-ce7df4c707ed", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30572024-11-22T04:03:28.791ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 352.711987ms iteration = 18 status = {}
30582024-11-22T04:03:28.798ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
30592024-11-22T04:03:28.798ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ccea468-5831-41a7-897f-ad61e45225af", "content-length": "691", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30602024-11-22T04:03:28.798ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
30612024-11-22T04:03:28.798ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
30622024-11-22T04:03:28.798ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
30632024-11-22T04:03:28.800ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 362.517452ms iteration = 18 status = {}
30642024-11-22T04:03:28.812ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30652024-11-22T04:03:28.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30662024-11-22T04:03:28.815ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
30672024-11-22T04:03:28.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30682024-11-22T04:03:28.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30692024-11-22T04:03:28.825ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
30702024-11-22T04:03:28.825ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc7aa4ef-d186-4b44-aae7-663cd3c8ae12", "content-length": "134", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30712024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
30722024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
30732024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
30742024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
30752024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30762024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30772024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30782024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30792024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
30802024-11-22T04:03:28.825ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
30812024-11-22T04:03:28.826ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
30822024-11-22T04:03:28.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30832024-11-22T04:03:28.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30842024-11-22T04:03:28.828ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
30852024-11-22T04:03:28.828ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "23c594c1-78f4-47fd-a4ce-59a25dd3bdb6", "content-length": "2", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30862024-11-22T04:03:28.828ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
30872024-11-22T04:03:28.828ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "914d3c54-f8d3-42ca-b85b-56eabbbc7b60", "content-length": "52", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30882024-11-22T04:03:28.828ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
30892024-11-22T04:03:28.828ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
30902024-11-22T04:03:28.924ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bd218926-7b32-4886-aab1-481b251eb504", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30912024-11-22T04:03:28.924ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
30922024-11-22T04:03:28.924ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
30932024-11-22T04:03:29.012ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2f4553c-ceaa-4ac6-9936-d78ea07fd339", "content-length": "682", "date": "Fri, 22 Nov 2024 04:03:28 GMT"} })
30942024-11-22T04:03:29.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30952024-11-22T04:03:29.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30962024-11-22T04:03:29.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30972024-11-22T04:03:29.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30982024-11-22T04:03:29.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30992024-11-22T04:03:29.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31002024-11-22T04:03:29.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31012024-11-22T04:03:29.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31022024-11-22T04:03:29.030ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 592.229038ms iteration = 18 status = {}
31032024-11-22T04:03:29.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 150b8c74-a3b2-4a5a-87d9-95d38eaab2d5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31042024-11-22T04:03:29.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 150b8c74-a3b2-4a5a-87d9-95d38eaab2d5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31052024-11-22T04:03:29.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2180 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 150b8c74-a3b2-4a5a-87d9-95d38eaab2d5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31062024-11-22T04:03:29.186ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
31072024-11-22T04:03:29.186ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
31082024-11-22T04:03:29.217ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
31092024-11-22T04:03:29.217ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:41307
31102024-11-22T04:03:29.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41307 req_id = 059755a7-da51-4bbc-96f9-2b0d83aab3da roles = RoleSet { roles: {} } uri = /metrics/producers
31112024-11-22T04:03:29.217ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41307 req_id = 059755a7-da51-4bbc-96f9-2b0d83aab3da resource = Database result = Ok(()) uri = /metrics/producers
31122024-11-22T04:03:29.262ZINFOnexus: assigned collector to new producer collector_id = 619dee3a-9d47-45ec-a665-d347c721dbd7 file = nexus/src/app/oximeter.rs:76 producer_id = 8af2b85f-6ab3-4781-9033-075825f48255
31132024-11-22T04:03:29.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45245 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41307 req_id = 059755a7-da51-4bbc-96f9-2b0d83aab3da response_code = 201 uri = /metrics/producers
31142024-11-22T04:03:29.262ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "059755a7-da51-4bbc-96f9-2b0d83aab3da", "content-length": "41", "date": "Fri, 22 Nov 2024 04:03:29 GMT"} })
31152024-11-22T04:03:29.264ZDEBGnexus (producer-registration-task): registered with nexus successfully
31162024-11-22T04:03:29.264ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
31172024-11-22T04:03:29.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 70f89494-b31f-4e84-83b9-089dc879cbc5 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
31182024-11-22T04:03:29.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 70f89494-b31f-4e84-83b9-089dc879cbc5 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
31192024-11-22T04:03:29.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 70f89494-b31f-4e84-83b9-089dc879cbc5 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
31202024-11-22T04:03:30.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7eed7d11-f60f-451d-b870-65fc054009b9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31212024-11-22T04:03:30.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7eed7d11-f60f-451d-b870-65fc054009b9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31222024-11-22T04:03:30.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2451 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7eed7d11-f60f-451d-b870-65fc054009b9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31232024-11-22T04:03:30.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 852 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 6c37917b-1c94-493f-9216-4cd68762d822 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
31242024-11-22T04:03:31.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 82ee0531-6e38-49a3-acfa-c1de40aa63d6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31252024-11-22T04:03:31.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 82ee0531-6e38-49a3-acfa-c1de40aa63d6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31262024-11-22T04:03:31.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2776 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 82ee0531-6e38-49a3-acfa-c1de40aa63d6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31272024-11-22T04:03:32.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49a39e2a-c36f-49d1-aab9-10a25d988d3a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31282024-11-22T04:03:32.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49a39e2a-c36f-49d1-aab9-10a25d988d3a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31292024-11-22T04:03:32.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 49a39e2a-c36f-49d1-aab9-10a25d988d3a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31302024-11-22T04:03:33.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c384ce0-a2d6-49d3-8334-ab1d984d1fd7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31312024-11-22T04:03:33.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c384ce0-a2d6-49d3-8334-ab1d984d1fd7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31322024-11-22T04:03:33.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c384ce0-a2d6-49d3-8334-ab1d984d1fd7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31332024-11-22T04:03:34.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a95fd9e1-3c3b-4365-aabf-cdff44288d60 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31342024-11-22T04:03:34.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a95fd9e1-3c3b-4365-aabf-cdff44288d60 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31352024-11-22T04:03:34.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a95fd9e1-3c3b-4365-aabf-cdff44288d60 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31362024-11-22T04:03:35.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5b81ee6c-9176-40c1-8586-84ccd61eeb46 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31372024-11-22T04:03:35.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5b81ee6c-9176-40c1-8586-84ccd61eeb46 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31382024-11-22T04:03:35.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2345 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5b81ee6c-9176-40c1-8586-84ccd61eeb46 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31392024-11-22T04:03:36.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8c515284-0a46-4e36-b5b4-4ca2e74d453e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31402024-11-22T04:03:36.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8c515284-0a46-4e36-b5b4-4ca2e74d453e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31412024-11-22T04:03:36.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2437 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8c515284-0a46-4e36-b5b4-4ca2e74d453e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31422024-11-22T04:03:37.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a0c99395-13ee-4de9-a7df-dd922466469a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31432024-11-22T04:03:37.292ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a0c99395-13ee-4de9-a7df-dd922466469a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31442024-11-22T04:03:37.294ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1774 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a0c99395-13ee-4de9-a7df-dd922466469a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31452024-11-22T04:03:38.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8e1db29c-1421-4a74-8c2a-5f433138031c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31462024-11-22T04:03:38.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8e1db29c-1421-4a74-8c2a-5f433138031c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31472024-11-22T04:03:38.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1650 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8e1db29c-1421-4a74-8c2a-5f433138031c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31482024-11-22T04:03:38.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
31492024-11-22T04:03:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
31502024-11-22T04:03:38.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31512024-11-22T04:03:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31522024-11-22T04:03:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31532024-11-22T04:03:38.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31542024-11-22T04:03:38.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31552024-11-22T04:03:38.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31562024-11-22T04:03:38.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31572024-11-22T04:03:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31582024-11-22T04:03:38.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31592024-11-22T04:03:38.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31602024-11-22T04:03:38.472ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.590564ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31612024-11-22T04:03:38.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31622024-11-22T04:03:38.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31632024-11-22T04:03:38.501ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31642024-11-22T04:03:38.504ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
31652024-11-22T04:03:38.504ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31662024-11-22T04:03:38.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31672024-11-22T04:03:38.516ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
31682024-11-22T04:03:38.516ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.808609ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
31692024-11-22T04:03:39.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b4f44e55-0761-4b88-94bd-0429393dae78 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31702024-11-22T04:03:39.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b4f44e55-0761-4b88-94bd-0429393dae78 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31712024-11-22T04:03:39.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2319 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b4f44e55-0761-4b88-94bd-0429393dae78 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31722024-11-22T04:03:40.355ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 027fd43e-699c-4ff2-997c-8fd66187424b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31732024-11-22T04:03:40.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 027fd43e-699c-4ff2-997c-8fd66187424b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31742024-11-22T04:03:40.357ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1877 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 027fd43e-699c-4ff2-997c-8fd66187424b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31752024-11-22T04:03:40.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 545 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 3045ab8b-21e2-4c8e-9eb4-4089c24e4acc response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
31762024-11-22T04:03:41.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65bb115a-31fe-4a0e-94d2-a12f6a292f2c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31772024-11-22T04:03:41.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65bb115a-31fe-4a0e-94d2-a12f6a292f2c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31782024-11-22T04:03:41.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65bb115a-31fe-4a0e-94d2-a12f6a292f2c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31792024-11-22T04:03:42.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 29e34b0a-52a6-41f7-a7bf-85a3433fd259 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31802024-11-22T04:03:42.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 29e34b0a-52a6-41f7-a7bf-85a3433fd259 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31812024-11-22T04:03:42.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1594 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 29e34b0a-52a6-41f7-a7bf-85a3433fd259 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31822024-11-22T04:03:43.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3e0f0d5b-41fc-40f8-8b55-a391568d9936 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31832024-11-22T04:03:43.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3e0f0d5b-41fc-40f8-8b55-a391568d9936 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31842024-11-22T04:03:43.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3e0f0d5b-41fc-40f8-8b55-a391568d9936 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31852024-11-22T04:03:44.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b05c4a31-6c17-4e3f-9a7f-48f85feb14b2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31862024-11-22T04:03:44.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b05c4a31-6c17-4e3f-9a7f-48f85feb14b2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31872024-11-22T04:03:44.441ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b05c4a31-6c17-4e3f-9a7f-48f85feb14b2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31882024-11-22T04:03:45.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9042279a-9d9f-4f2a-8bcc-52a9b67c4770 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31892024-11-22T04:03:45.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9042279a-9d9f-4f2a-8bcc-52a9b67c4770 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31902024-11-22T04:03:45.462ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9042279a-9d9f-4f2a-8bcc-52a9b67c4770 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31912024-11-22T04:03:46.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b7ab232-1149-42c8-96e4-002f38a81a39 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31922024-11-22T04:03:46.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b7ab232-1149-42c8-96e4-002f38a81a39 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31932024-11-22T04:03:46.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2195 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b7ab232-1149-42c8-96e4-002f38a81a39 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31942024-11-22T04:03:47.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4ab74f06-4c71-4451-b52e-3960cfc8f3dd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31952024-11-22T04:03:47.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4ab74f06-4c71-4451-b52e-3960cfc8f3dd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31962024-11-22T04:03:47.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4ab74f06-4c71-4451-b52e-3960cfc8f3dd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
31972024-11-22T04:03:48.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
31982024-11-22T04:03:48.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
31992024-11-22T04:03:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32002024-11-22T04:03:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32012024-11-22T04:03:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32022024-11-22T04:03:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32032024-11-22T04:03:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32042024-11-22T04:03:48.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32052024-11-22T04:03:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32062024-11-22T04:03:48.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.609801ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32072024-11-22T04:03:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32082024-11-22T04:03:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32092024-11-22T04:03:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32102024-11-22T04:03:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32112024-11-22T04:03:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32122024-11-22T04:03:48.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32132024-11-22T04:03:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
32142024-11-22T04:03:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32152024-11-22T04:03:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32162024-11-22T04:03:48.458ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
32172024-11-22T04:03:48.458ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.547065ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
32182024-11-22T04:03:48.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a65b595-252a-405e-a0fb-4f1afc7be564 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32192024-11-22T04:03:48.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a65b595-252a-405e-a0fb-4f1afc7be564 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32202024-11-22T04:03:48.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1994 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a65b595-252a-405e-a0fb-4f1afc7be564 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32212024-11-22T04:03:49.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fdd1726d-b137-456d-95c1-ffe0b4fa01d4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32222024-11-22T04:03:49.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fdd1726d-b137-456d-95c1-ffe0b4fa01d4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32232024-11-22T04:03:49.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2204 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fdd1726d-b137-456d-95c1-ffe0b4fa01d4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32242024-11-22T04:03:50.565ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78a5f0fa-84b8-4b77-98f2-dbbfd0558f66 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32252024-11-22T04:03:50.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78a5f0fa-84b8-4b77-98f2-dbbfd0558f66 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32262024-11-22T04:03:50.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2191 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78a5f0fa-84b8-4b77-98f2-dbbfd0558f66 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32272024-11-22T04:03:50.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 559 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 4b50ec79-d0ed-4730-9726-18ae3674f58a response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
32282024-11-22T04:03:51.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 41066bf7-e56d-4cda-8a29-76cd0a59c8a7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32292024-11-22T04:03:51.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 41066bf7-e56d-4cda-8a29-76cd0a59c8a7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32302024-11-22T04:03:51.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2107 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 41066bf7-e56d-4cda-8a29-76cd0a59c8a7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32312024-11-22T04:03:52.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 405caecc-c8b7-4c75-aa5b-8a1050f8efda roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32322024-11-22T04:03:52.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 405caecc-c8b7-4c75-aa5b-8a1050f8efda resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32332024-11-22T04:03:52.613ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1933 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 405caecc-c8b7-4c75-aa5b-8a1050f8efda response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32342024-11-22T04:03:53.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a746509b-3199-41cb-925f-c94aba83730b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32352024-11-22T04:03:53.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a746509b-3199-41cb-925f-c94aba83730b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32362024-11-22T04:03:53.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2217 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a746509b-3199-41cb-925f-c94aba83730b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32372024-11-22T04:03:54.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3217cebf-6775-4848-abea-0c04e3d91425 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32382024-11-22T04:03:54.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3217cebf-6775-4848-abea-0c04e3d91425 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32392024-11-22T04:03:54.655ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3217cebf-6775-4848-abea-0c04e3d91425 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32402024-11-22T04:03:55.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3421360f-d28b-4228-b694-c4c32f25f182 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32412024-11-22T04:03:55.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3421360f-d28b-4228-b694-c4c32f25f182 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32422024-11-22T04:03:55.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3421360f-d28b-4228-b694-c4c32f25f182 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32432024-11-22T04:03:56.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 12cc6496-6f9e-4aa4-92ec-35af8f5d1351 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32442024-11-22T04:03:56.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 12cc6496-6f9e-4aa4-92ec-35af8f5d1351 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32452024-11-22T04:03:56.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1454 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 12cc6496-6f9e-4aa4-92ec-35af8f5d1351 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32462024-11-22T04:03:57.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6a9e64a2-58f5-4efa-8a59-1de02c837b2c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32472024-11-22T04:03:57.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6a9e64a2-58f5-4efa-8a59-1de02c837b2c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32482024-11-22T04:03:57.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2050 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6a9e64a2-58f5-4efa-8a59-1de02c837b2c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
32492024-11-22T04:03:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
32502024-11-22T04:03:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
32512024-11-22T04:03:58.436ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
32522024-11-22T04:03:58.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32532024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32542024-11-22T04:03:58.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 788467983 } })
32552024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
32562024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
32572024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32582024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
32592024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
32602024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32612024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32622024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
32632024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
32642024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
32652024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32662024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
32672024-11-22T04:03:58.437ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:53:58.437685700 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
32682024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
32692024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
32702024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32712024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
32722024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32732024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
32742024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32752024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
32762024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32772024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
32782024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
32792024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
32802024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
32812024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
32822024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
32832024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32842024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
32852024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
32862024-11-22T04:03:58.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32872024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32882024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32892024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
32902024-11-22T04:03:58.437ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
32912024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32922024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
32932024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32942024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
32952024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32962024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
32972024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32982024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
32992024-11-22T04:03:58.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
33002024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.471\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
33012024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
33022024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
33032024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
33042024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33052024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
33062024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33072024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33082024-11-22T04:03:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
33092024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
33102024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33112024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33122024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
33132024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33142024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
33152024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
33162024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33172024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33182024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33192024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33202024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33212024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
33222024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.573888ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
33232024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33242024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33252024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33262024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33272024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33282024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33292024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33302024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33312024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33322024-11-22T04:03:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 789737716 } })
33332024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33342024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33352024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33362024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33372024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33382024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33392024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33402024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33412024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33422024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33432024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33442024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33452024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33462024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33472024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33482024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33492024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
33502024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.112649ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
33512024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33522024-11-22T04:03:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33532024-11-22T04:03:58.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33542024-11-22T04:03:58.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33552024-11-22T04:03:58.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33562024-11-22T04:03:58.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.034232ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33572024-11-22T04:03:58.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 793339690 } })
33582024-11-22T04:03:58.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33592024-11-22T04:03:58.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
33602024-11-22T04:03:58.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 794078793 } })
33612024-11-22T04:03:58.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
33622024-11-22T04:03:58.443ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33632024-11-22T04:03:58.443ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:53:58.437685700 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
33642024-11-22T04:03:58.443ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.24399ms iteration = 10 status = {"expiration":"2024-11-22T03:53:58.437685700Z","pruned":[]}
33652024-11-22T04:03:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
33662024-11-22T04:03:58.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33672024-11-22T04:03:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33682024-11-22T04:03:58.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.846042ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
33692024-11-22T04:03:58.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33702024-11-22T04:03:58.445ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33712024-11-22T04:03:58.446ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33722024-11-22T04:03:58.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33732024-11-22T04:03:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33742024-11-22T04:03:58.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
33752024-11-22T04:03:58.448ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
33762024-11-22T04:03:58.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
33772024-11-22T04:03:58.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33782024-11-22T04:03:58.450ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33792024-11-22T04:03:58.451ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33802024-11-22T04:03:58.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
33812024-11-22T04:03:58.452ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33822024-11-22T04:03:58.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33832024-11-22T04:03:58.454ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
33842024-11-22T04:03:58.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33852024-11-22T04:03:58.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33862024-11-22T04:03:58.458ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.307281ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
33872024-11-22T04:03:58.497ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33882024-11-22T04:03:58.497ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33892024-11-22T04:03:58.497ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.810851ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33902024-11-22T04:03:58.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33912024-11-22T04:03:58.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33922024-11-22T04:03:58.503ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33932024-11-22T04:03:58.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33942024-11-22T04:03:58.505ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33952024-11-22T04:03:58.505ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
33962024-11-22T04:03:58.505ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33972024-11-22T04:03:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33982024-11-22T04:03:58.507ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33992024-11-22T04:03:58.508ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34002024-11-22T04:03:58.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34012024-11-22T04:03:58.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34022024-11-22T04:03:58.509ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34032024-11-22T04:03:58.509ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34042024-11-22T04:03:58.509ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34052024-11-22T04:03:58.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34062024-11-22T04:03:58.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34072024-11-22T04:03:58.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34082024-11-22T04:03:58.509ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34092024-11-22T04:03:58.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34102024-11-22T04:03:58.510ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112024-11-22T04:03:58.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34122024-11-22T04:03:58.511ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34132024-11-22T04:03:58.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34142024-11-22T04:03:58.511ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34152024-11-22T04:03:58.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34162024-11-22T04:03:58.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34172024-11-22T04:03:58.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34182024-11-22T04:03:58.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34192024-11-22T04:03:58.513ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202024-11-22T04:03:58.514ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34212024-11-22T04:03:58.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34222024-11-22T04:03:58.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34232024-11-22T04:03:58.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.077215ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
34242024-11-22T04:03:58.516ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
34252024-11-22T04:03:58.516ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34262024-11-22T04:03:58.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34272024-11-22T04:03:58.517ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34282024-11-22T04:03:58.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34292024-11-22T04:03:58.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34302024-11-22T04:03:58.517ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34312024-11-22T04:03:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
34322024-11-22T04:03:58.518ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34332024-11-22T04:03:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34342024-11-22T04:03:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34352024-11-22T04:03:58.519ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34362024-11-22T04:03:58.519ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34372024-11-22T04:03:58.519ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34382024-11-22T04:03:58.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34392024-11-22T04:03:58.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34402024-11-22T04:03:58.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34412024-11-22T04:03:58.521ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34422024-11-22T04:03:58.521ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34432024-11-22T04:03:58.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34442024-11-22T04:03:58.521ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34452024-11-22T04:03:58.521ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34462024-11-22T04:03:58.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34472024-11-22T04:03:58.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34482024-11-22T04:03:58.523ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34492024-11-22T04:03:58.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34502024-11-22T04:03:58.523ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34512024-11-22T04:03:58.525ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34522024-11-22T04:03:58.525ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34532024-11-22T04:03:58.525ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34542024-11-22T04:03:58.525ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34552024-11-22T04:03:58.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34562024-11-22T04:03:58.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34572024-11-22T04:03:58.526ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34582024-11-22T04:03:58.526ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34592024-11-22T04:03:58.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34602024-11-22T04:03:58.526ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34612024-11-22T04:03:58.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
34622024-11-22T04:03:58.528ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
34632024-11-22T04:03:58.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
34642024-11-22T04:03:58.530ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34652024-11-22T04:03:58.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34662024-11-22T04:03:58.532ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1467, tv_nsec: 883610002 } })
34672024-11-22T04:03:58.532ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
34682024-11-22T04:03:58.533ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34692024-11-22T04:03:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34702024-11-22T04:03:58.534ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 96.773857ms iteration = 5 status = {"nsuccess":5}
34712024-11-22T04:03:58.535ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34722024-11-22T04:03:58.536ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34732024-11-22T04:03:58.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34742024-11-22T04:03:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
34752024-11-22T04:03:58.538ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34762024-11-22T04:03:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34772024-11-22T04:03:58.539ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34782024-11-22T04:03:58.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34792024-11-22T04:03:58.539ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
34802024-11-22T04:03:58.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
34812024-11-22T04:03:58.540ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34822024-11-22T04:03:58.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34832024-11-22T04:03:58.544ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
34842024-11-22T04:03:58.544ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
34852024-11-22T04:03:58.544ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 106.323417ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
34862024-11-22T04:03:58.544ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
34872024-11-22T04:03:58.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34882024-11-22T04:03:58.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34892024-11-22T04:03:58.545ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
34902024-11-22T04:03:58.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
34912024-11-22T04:03:58.547ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.517534ms iteration = 19 status = 0
34922024-11-22T04:03:58.550ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34932024-11-22T04:03:58.550ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34942024-11-22T04:03:58.550ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "969b63bf-cfe1-4d55-ad2c-c3764b029624", "content-length": "26", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
34952024-11-22T04:03:58.550ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34962024-11-22T04:03:58.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
34972024-11-22T04:03:58.551ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34982024-11-22T04:03:58.551ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d315c270-cdf7-4739-8b44-90fb0ce7755f", "content-length": "26", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
34992024-11-22T04:03:58.551ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35002024-11-22T04:03:58.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35012024-11-22T04:03:58.556ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35022024-11-22T04:03:58.560ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
35032024-11-22T04:03:58.560ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 122.902701ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
35042024-11-22T04:03:58.561ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35052024-11-22T04:03:58.561ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
35062024-11-22T04:03:58.561ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
35072024-11-22T04:03:58.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
35082024-11-22T04:03:58.562ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 124.163903ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35092024-11-22T04:03:58.565ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 127.402651ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35102024-11-22T04:03:58.570ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35112024-11-22T04:03:58.570ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35122024-11-22T04:03:58.570ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35132024-11-22T04:03:58.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35142024-11-22T04:03:58.571ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35152024-11-22T04:03:58.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35162024-11-22T04:03:58.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35172024-11-22T04:03:58.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35182024-11-22T04:03:58.572ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
35192024-11-22T04:03:58.572ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
35202024-11-22T04:03:58.572ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
35212024-11-22T04:03:58.572ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35222024-11-22T04:03:58.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35232024-11-22T04:03:58.573ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35242024-11-22T04:03:58.573ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 135.84113ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35252024-11-22T04:03:58.574ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35262024-11-22T04:03:58.575ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35272024-11-22T04:03:58.575ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35282024-11-22T04:03:58.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35292024-11-22T04:03:58.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35302024-11-22T04:03:58.577ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35312024-11-22T04:03:58.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35322024-11-22T04:03:58.579ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
35332024-11-22T04:03:58.579ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35342024-11-22T04:03:58.579ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
35352024-11-22T04:03:58.579ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 142.528879ms iteration = 10 status = {"generation":1}
35362024-11-22T04:03:58.584ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 146.547431ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
35372024-11-22T04:03:58.586ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 148.918952ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
35382024-11-22T04:03:58.613ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35392024-11-22T04:03:58.613ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35402024-11-22T04:03:58.613ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.190708ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35412024-11-22T04:03:58.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35422024-11-22T04:03:58.621ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) }
35432024-11-22T04:03:58.621ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 183.511556ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
35442024-11-22T04:03:58.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35452024-11-22T04:03:58.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35462024-11-22T04:03:58.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35472024-11-22T04:03:58.672ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35482024-11-22T04:03:58.672ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
35492024-11-22T04:03:58.672ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35502024-11-22T04:03:58.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35512024-11-22T04:03:58.674ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35522024-11-22T04:03:58.674ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 237.062766ms iteration = 21 status = {"physical_disks_added":0}
35532024-11-22T04:03:58.676ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
35542024-11-22T04:03:58.676ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 238.99127ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35552024-11-22T04:03:58.678ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35562024-11-22T04:03:58.678ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35572024-11-22T04:03:58.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35582024-11-22T04:03:58.684ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
35592024-11-22T04:03:58.684ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35602024-11-22T04:03:58.685ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2e6363a-336d-456e-8810-03a82a437528", "content-length": "26", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
35612024-11-22T04:03:58.685ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35622024-11-22T04:03:58.687ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
35632024-11-22T04:03:58.705ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35642024-11-22T04:03:58.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35652024-11-22T04:03:58.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9a490f71-7897-4a4e-8c0a-7858381177ff roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
35662024-11-22T04:03:58.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9a490f71-7897-4a4e-8c0a-7858381177ff resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
35672024-11-22T04:03:58.767ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 329.795361ms iteration = 19 status = {}
35682024-11-22T04:03:58.784ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35692024-11-22T04:03:58.785ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ab05633f-7432-4d9f-84fc-f72421438773", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35702024-11-22T04:03:58.785ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35712024-11-22T04:03:58.787ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "68e78daa-c74d-4cd2-9921-966feebd67f1", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35722024-11-22T04:03:58.787ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35732024-11-22T04:03:58.793ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
35742024-11-22T04:03:58.793ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 355.05631ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
35752024-11-22T04:03:58.812ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35762024-11-22T04:03:58.812ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35772024-11-22T04:03:58.812ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7b3df8c-3846-48c8-83cc-602347bed394", "content-length": "372", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
35782024-11-22T04:03:58.812ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35792024-11-22T04:03:58.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35802024-11-22T04:03:58.814ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
35812024-11-22T04:03:58.814ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35822024-11-22T04:03:58.814ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
35832024-11-22T04:03:58.814ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 376.445549ms iteration = 10 status = {"generation":2}
35842024-11-22T04:03:58.814ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35852024-11-22T04:03:58.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79531 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9a490f71-7897-4a4e-8c0a-7858381177ff response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
35862024-11-22T04:03:58.817ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35872024-11-22T04:03:58.817ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35882024-11-22T04:03:58.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35892024-11-22T04:03:58.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35902024-11-22T04:03:58.822ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
35912024-11-22T04:03:58.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35922024-11-22T04:03:58.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35932024-11-22T04:03:58.824ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
35942024-11-22T04:03:58.826ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
35952024-11-22T04:03:58.827ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5494cae9-c144-48de-a032-f5ee1d3448dc", "content-length": "1", "date": "Fri, 22 Nov 2024 04:03:57 GMT"} })
35962024-11-22T04:03:58.828ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
35972024-11-22T04:03:58.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
35982024-11-22T04:03:58.831ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 393.770597ms iteration = 19 status = null
35992024-11-22T04:03:58.868ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36002024-11-22T04:03:58.868ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36012024-11-22T04:03:58.869ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1c75dedd-6c7e-4dd5-a61e-8e2121377b2f", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
36022024-11-22T04:03:58.869ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36032024-11-22T04:03:58.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36042024-11-22T04:03:58.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36052024-11-22T04:03:58.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36062024-11-22T04:03:58.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36072024-11-22T04:03:58.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36082024-11-22T04:03:58.886ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36092024-11-22T04:03:58.886ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36102024-11-22T04:03:58.887ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "00931170-99dd-4458-a777-3142d08e803d", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
36112024-11-22T04:03:58.889ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 451.784446ms iteration = 19 status = {}
36122024-11-22T04:03:58.904ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
36132024-11-22T04:03:58.904ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4b151cfa-2db6-4975-b402-c2f8ec8088c7", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
36142024-11-22T04:03:58.904ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
36152024-11-22T04:03:58.906ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36162024-11-22T04:03:58.907ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "7852693f-6d26-4621-a365-9d3764330db7", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
36172024-11-22T04:03:58.907ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
36182024-11-22T04:03:58.907ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0937b63c-2c55-4780-a6f2-ce4c12741fc8", "content-length": "691", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
36192024-11-22T04:03:58.907ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36202024-11-22T04:03:58.907ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36212024-11-22T04:03:58.907ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36222024-11-22T04:03:58.909ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a05cac03-289b-4a8d-84d2-c0484168ca75", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
36232024-11-22T04:03:58.909ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
36242024-11-22T04:03:58.909ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 471.672618ms iteration = 19 status = {}
36252024-11-22T04:03:58.911ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
36262024-11-22T04:03:58.911ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 473.615974ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36272024-11-22T04:03:58.945ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36282024-11-22T04:03:58.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36292024-11-22T04:03:58.947ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
36302024-11-22T04:03:58.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36312024-11-22T04:03:58.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36322024-11-22T04:03:58.958ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
36332024-11-22T04:03:58.958ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e21dc91-1b80-4112-bfbd-16865dc72905", "content-length": "134", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
36342024-11-22T04:03:58.958ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36352024-11-22T04:03:58.958ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
36362024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36372024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36382024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36392024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36402024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36412024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36422024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36432024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36442024-11-22T04:03:58.959ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
36452024-11-22T04:03:58.959ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36462024-11-22T04:03:58.959ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36472024-11-22T04:03:58.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
36482024-11-22T04:03:58.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3561b397-7a72-4d91-8638-430369b5adb8", "content-length": "2", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
36492024-11-22T04:03:58.962ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
36502024-11-22T04:03:58.962ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0135ac47-439f-4051-af95-04ff46884c64", "content-length": "52", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
36512024-11-22T04:03:58.962ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
36522024-11-22T04:03:58.962ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36532024-11-22T04:03:59.053ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7d09f973-3941-4007-b3bb-7b7904ac6ab6", "date": "Fri, 22 Nov 2024 04:03:58 GMT"} })
36542024-11-22T04:03:59.053ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
36552024-11-22T04:03:59.053ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36562024-11-22T04:03:59.056ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f68ec8fe-c438-4924-998f-d07efdf7bc94", "content-length": "682", "date": "Fri, 22 Nov 2024 04:03:59 GMT"} })
36572024-11-22T04:03:59.056ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36582024-11-22T04:03:59.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36592024-11-22T04:03:59.061ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36602024-11-22T04:03:59.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36612024-11-22T04:03:59.064ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36622024-11-22T04:03:59.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36632024-11-22T04:03:59.067ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36642024-11-22T04:03:59.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36652024-11-22T04:03:59.075ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 637.510561ms iteration = 19 status = {}
36662024-11-22T04:03:59.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = fa507146-98a0-46a9-9292-7160238737ab roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
36672024-11-22T04:03:59.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = fa507146-98a0-46a9-9292-7160238737ab resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
36682024-11-22T04:03:59.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2600 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = fa507146-98a0-46a9-9292-7160238737ab response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
36692024-11-22T04:03:59.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 07c63a43-9522-4b5e-bc5e-5f31a5be84fc roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36702024-11-22T04:03:59.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 07c63a43-9522-4b5e-bc5e-5f31a5be84fc resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36712024-11-22T04:03:59.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 07c63a43-9522-4b5e-bc5e-5f31a5be84fc response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36722024-11-22T04:04:00.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 490 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = a1fabd21-cdf9-4f97-b16d-fdae672d6ac1 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
36732024-11-22T04:04:00.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1aa2cdf-d553-4e50-98ec-e2ebbc4a51de roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36742024-11-22T04:04:00.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1aa2cdf-d553-4e50-98ec-e2ebbc4a51de resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36752024-11-22T04:04:00.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1aa2cdf-d553-4e50-98ec-e2ebbc4a51de response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36762024-11-22T04:04:01.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 055f76fb-514f-4404-8546-a6c13972846c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36772024-11-22T04:04:01.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 055f76fb-514f-4404-8546-a6c13972846c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36782024-11-22T04:04:01.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1919 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 055f76fb-514f-4404-8546-a6c13972846c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36792024-11-22T04:04:02.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1486d99-f08e-4ad6-8c0f-42cc2cd0e027 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36802024-11-22T04:04:02.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1486d99-f08e-4ad6-8c0f-42cc2cd0e027 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36812024-11-22T04:04:02.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2020 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1486d99-f08e-4ad6-8c0f-42cc2cd0e027 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36822024-11-22T04:04:03.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 66474974-99d2-47d2-9fce-44cf4ade0b9d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36832024-11-22T04:04:03.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 66474974-99d2-47d2-9fce-44cf4ade0b9d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36842024-11-22T04:04:03.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 66474974-99d2-47d2-9fce-44cf4ade0b9d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36852024-11-22T04:04:04.939ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7e331870-1b38-4250-970f-9dd3fab2f7f4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36862024-11-22T04:04:04.939ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7e331870-1b38-4250-970f-9dd3fab2f7f4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36872024-11-22T04:04:04.941ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2144 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7e331870-1b38-4250-970f-9dd3fab2f7f4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36882024-11-22T04:04:05.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee13d65c-b78a-4897-93b0-ca86436b7eab roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36892024-11-22T04:04:05.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee13d65c-b78a-4897-93b0-ca86436b7eab resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36902024-11-22T04:04:05.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2303 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee13d65c-b78a-4897-93b0-ca86436b7eab response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36912024-11-22T04:04:06.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 660f9274-9162-45ac-8758-805fd85e9f17 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36922024-11-22T04:04:06.980ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 660f9274-9162-45ac-8758-805fd85e9f17 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36932024-11-22T04:04:06.982ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1865 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 660f9274-9162-45ac-8758-805fd85e9f17 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36942024-11-22T04:04:08.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98d05f2b-64a0-4472-8368-9bd62e960294 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36952024-11-22T04:04:08.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98d05f2b-64a0-4472-8368-9bd62e960294 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36962024-11-22T04:04:08.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 98d05f2b-64a0-4472-8368-9bd62e960294 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
36972024-11-22T04:04:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
36982024-11-22T04:04:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36992024-11-22T04:04:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
37002024-11-22T04:04:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37012024-11-22T04:04:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37022024-11-22T04:04:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37032024-11-22T04:04:08.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37042024-11-22T04:04:08.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37052024-11-22T04:04:08.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37062024-11-22T04:04:08.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37072024-11-22T04:04:08.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37082024-11-22T04:04:08.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37092024-11-22T04:04:08.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37102024-11-22T04:04:08.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37112024-11-22T04:04:08.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37122024-11-22T04:04:08.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
37132024-11-22T04:04:08.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37142024-11-22T04:04:08.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37152024-11-22T04:04:08.485ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
37162024-11-22T04:04:08.485ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.544926ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
37172024-11-22T04:04:08.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.864887ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37182024-11-22T04:04:09.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0bc9deca-1c07-4064-a55c-29788d48b357 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37192024-11-22T04:04:09.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0bc9deca-1c07-4064-a55c-29788d48b357 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37202024-11-22T04:04:09.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2026 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0bc9deca-1c07-4064-a55c-29788d48b357 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37212024-11-22T04:04:10.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 972f4110-0814-4631-8b3b-2eaa5af6762c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37222024-11-22T04:04:10.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 972f4110-0814-4631-8b3b-2eaa5af6762c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37232024-11-22T04:04:10.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2038 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 972f4110-0814-4631-8b3b-2eaa5af6762c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37242024-11-22T04:04:10.626ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:48388
37252024-11-22T04:04:10.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 3ee05dd7-6447-4202-8650-3b0bd2ad5f90 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
37262024-11-22T04:04:10.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 3ee05dd7-6447-4202-8650-3b0bd2ad5f90 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
37272024-11-22T04:04:10.628ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2154 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 3ee05dd7-6447-4202-8650-3b0bd2ad5f90 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
37282024-11-22T04:04:10.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 542282fe-0e4a-4aec-a018-38fc9dbc3feb roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
37292024-11-22T04:04:10.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 542282fe-0e4a-4aec-a018-38fc9dbc3feb resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
37302024-11-22T04:04:10.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 542282fe-0e4a-4aec-a018-38fc9dbc3feb response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
37312024-11-22T04:04:10.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 433 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 81472043-2746-4926-9aae-db45a9593cbf response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
37322024-11-22T04:04:11.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 30487852-b6b7-41f5-9d77-a78a226880d5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37332024-11-22T04:04:11.066ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 30487852-b6b7-41f5-9d77-a78a226880d5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37342024-11-22T04:04:11.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2089 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 30487852-b6b7-41f5-9d77-a78a226880d5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37352024-11-22T04:04:12.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6df39fc-56fb-4a4b-8f04-a785a669cdd8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37362024-11-22T04:04:12.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6df39fc-56fb-4a4b-8f04-a785a669cdd8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37372024-11-22T04:04:12.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2332 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6df39fc-56fb-4a4b-8f04-a785a669cdd8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37382024-11-22T04:04:13.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2be50d53-8516-4cd1-b45e-f692d301361d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37392024-11-22T04:04:13.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2be50d53-8516-4cd1-b45e-f692d301361d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37402024-11-22T04:04:13.111ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2162 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2be50d53-8516-4cd1-b45e-f692d301361d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37412024-11-22T04:04:14.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df868a3f-57d5-49f7-8304-c590fd3f0d34 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37422024-11-22T04:04:14.132ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df868a3f-57d5-49f7-8304-c590fd3f0d34 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37432024-11-22T04:04:14.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df868a3f-57d5-49f7-8304-c590fd3f0d34 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37442024-11-22T04:04:15.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c9c2c88a-f5bc-40e2-9eb2-65407dbe47f5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37452024-11-22T04:04:15.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c9c2c88a-f5bc-40e2-9eb2-65407dbe47f5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37462024-11-22T04:04:15.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2140 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c9c2c88a-f5bc-40e2-9eb2-65407dbe47f5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37472024-11-22T04:04:16.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2672e353-9a48-4728-a9d1-8668ce0b8e31 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37482024-11-22T04:04:16.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2672e353-9a48-4728-a9d1-8668ce0b8e31 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37492024-11-22T04:04:16.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2353 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2672e353-9a48-4728-a9d1-8668ce0b8e31 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37502024-11-22T04:04:17.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9c9319ee-c047-486b-beaa-34ea82d8f75c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37512024-11-22T04:04:17.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9c9319ee-c047-486b-beaa-34ea82d8f75c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37522024-11-22T04:04:17.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2033 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9c9319ee-c047-486b-beaa-34ea82d8f75c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37532024-11-22T04:04:18.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 32aee4f2-35c0-4cf6-8f40-53c9e8839143 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37542024-11-22T04:04:18.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 32aee4f2-35c0-4cf6-8f40-53c9e8839143 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37552024-11-22T04:04:18.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1588 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 32aee4f2-35c0-4cf6-8f40-53c9e8839143 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37562024-11-22T04:04:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
37572024-11-22T04:04:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
37582024-11-22T04:04:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37592024-11-22T04:04:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37602024-11-22T04:04:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37612024-11-22T04:04:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37622024-11-22T04:04:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37632024-11-22T04:04:18.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37642024-11-22T04:04:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37652024-11-22T04:04:18.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.408029ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37662024-11-22T04:04:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37672024-11-22T04:04:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37682024-11-22T04:04:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37692024-11-22T04:04:18.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37702024-11-22T04:04:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37712024-11-22T04:04:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37722024-11-22T04:04:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
37732024-11-22T04:04:18.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37742024-11-22T04:04:18.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37752024-11-22T04:04:18.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
37762024-11-22T04:04:18.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.18632ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
37772024-11-22T04:04:19.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8112861b-63ba-4aed-98ab-cc0b70c3576e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37782024-11-22T04:04:19.237ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8112861b-63ba-4aed-98ab-cc0b70c3576e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37792024-11-22T04:04:19.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2138 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8112861b-63ba-4aed-98ab-cc0b70c3576e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37802024-11-22T04:04:20.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3d0b17f1-9248-49e5-bcdc-bba2065a3e1e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37812024-11-22T04:04:20.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3d0b17f1-9248-49e5-bcdc-bba2065a3e1e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37822024-11-22T04:04:20.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1909 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3d0b17f1-9248-49e5-bcdc-bba2065a3e1e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37832024-11-22T04:04:20.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 530 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 7571c03f-56db-4db7-857b-07b3f34b11d8 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
37842024-11-22T04:04:21.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4ca4d9da-f85c-45af-9d25-871ce0fa841d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37852024-11-22T04:04:21.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4ca4d9da-f85c-45af-9d25-871ce0fa841d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37862024-11-22T04:04:21.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2362 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4ca4d9da-f85c-45af-9d25-871ce0fa841d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37872024-11-22T04:04:22.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2b5bf446-e2b5-4066-ae50-ee65c7549333 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37882024-11-22T04:04:22.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2b5bf446-e2b5-4066-ae50-ee65c7549333 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37892024-11-22T04:04:22.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1842 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2b5bf446-e2b5-4066-ae50-ee65c7549333 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37902024-11-22T04:04:23.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fddf1e07-f645-4d1e-b7be-7982f6d02204 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37912024-11-22T04:04:23.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fddf1e07-f645-4d1e-b7be-7982f6d02204 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37922024-11-22T04:04:23.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2272 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fddf1e07-f645-4d1e-b7be-7982f6d02204 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37932024-11-22T04:04:24.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ef4aca5-aa36-4ac9-b2b6-3442a9e6d666 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37942024-11-22T04:04:24.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ef4aca5-aa36-4ac9-b2b6-3442a9e6d666 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37952024-11-22T04:04:24.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2133 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3ef4aca5-aa36-4ac9-b2b6-3442a9e6d666 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37962024-11-22T04:04:25.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c5f58f92-1bc7-4520-a096-6b1f91464a1a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37972024-11-22T04:04:25.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c5f58f92-1bc7-4520-a096-6b1f91464a1a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37982024-11-22T04:04:25.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2012 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c5f58f92-1bc7-4520-a096-6b1f91464a1a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
37992024-11-22T04:04:25.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 07b0397f-3518-4f18-8ee7-3fb359d73239 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
38002024-11-22T04:04:25.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 07b0397f-3518-4f18-8ee7-3fb359d73239 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
38012024-11-22T04:04:25.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3037 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 07b0397f-3518-4f18-8ee7-3fb359d73239 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
38022024-11-22T04:04:25.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = ba9410fc-af86-467f-bee0-c0318a9fe963 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
38032024-11-22T04:04:25.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = ba9410fc-af86-467f-bee0-c0318a9fe963 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
38042024-11-22T04:04:25.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = ba9410fc-af86-467f-bee0-c0318a9fe963 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
38052024-11-22T04:04:26.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 163085f5-43a6-4cc8-8bae-535fdbab4993 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38062024-11-22T04:04:26.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 163085f5-43a6-4cc8-8bae-535fdbab4993 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38072024-11-22T04:04:26.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2440 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 163085f5-43a6-4cc8-8bae-535fdbab4993 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38082024-11-22T04:04:27.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2487b02a-ca9d-4ace-a234-c98f9da6084d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38092024-11-22T04:04:27.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2487b02a-ca9d-4ace-a234-c98f9da6084d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38102024-11-22T04:04:27.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2159 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2487b02a-ca9d-4ace-a234-c98f9da6084d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38112024-11-22T04:04:28.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 241a045a-e7e8-488e-be60-b76e948db599 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38122024-11-22T04:04:28.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 241a045a-e7e8-488e-be60-b76e948db599 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38132024-11-22T04:04:28.428ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 241a045a-e7e8-488e-be60-b76e948db599 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
38142024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
38152024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38162024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
38172024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
38182024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38192024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38202024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
38212024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
38222024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38232024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38242024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
38252024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
38262024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38272024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38282024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
38292024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
38302024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38312024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
38322024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38332024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38342024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
38352024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
38362024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38372024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38382024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
38392024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38402024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
38412024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
38422024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38432024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
38442024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38452024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38462024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
38472024-11-22T04:04:28.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38482024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38492024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38502024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38512024-11-22T04:04:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38522024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38532024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38542024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38552024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38562024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38572024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38582024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38592024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38602024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38612024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38622024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38632024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38642024-11-22T04:04:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38652024-11-22T04:04:28.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 792550936 } })
38662024-11-22T04:04:28.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 792657968 } })
38672024-11-22T04:04:28.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
38682024-11-22T04:04:28.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
38692024-11-22T04:04:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38702024-11-22T04:04:28.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.648575ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
38712024-11-22T04:04:28.442ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38722024-11-22T04:04:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38732024-11-22T04:04:28.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38742024-11-22T04:04:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38752024-11-22T04:04:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38762024-11-22T04:04:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38772024-11-22T04:04:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
38782024-11-22T04:04:28.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38792024-11-22T04:04:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38802024-11-22T04:04:28.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38812024-11-22T04:04:28.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38822024-11-22T04:04:28.449ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38832024-11-22T04:04:28.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38842024-11-22T04:04:28.450ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38852024-11-22T04:04:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38862024-11-22T04:04:28.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38872024-11-22T04:04:28.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882024-11-22T04:04:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38892024-11-22T04:04:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38902024-11-22T04:04:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38912024-11-22T04:04:28.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38922024-11-22T04:04:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38932024-11-22T04:04:28.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38942024-11-22T04:04:28.452ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38952024-11-22T04:04:28.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38962024-11-22T04:04:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38972024-11-22T04:04:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38982024-11-22T04:04:28.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38992024-11-22T04:04:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39002024-11-22T04:04:28.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39012024-11-22T04:04:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39022024-11-22T04:04:28.458ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1497, tv_nsec: 809742971 } })
39032024-11-22T04:04:28.458ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
39042024-11-22T04:04:28.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39052024-11-22T04:04:28.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39062024-11-22T04:04:28.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39072024-11-22T04:04:28.460ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39082024-11-22T04:04:28.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39092024-11-22T04:04:28.464ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39102024-11-22T04:04:28.464ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39112024-11-22T04:04:28.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39122024-11-22T04:04:28.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39132024-11-22T04:04:28.467ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39142024-11-22T04:04:28.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39152024-11-22T04:04:28.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39162024-11-22T04:04:28.467ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.469855ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39172024-11-22T04:04:28.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39182024-11-22T04:04:28.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.910434ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
39192024-11-22T04:04:28.485ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39202024-11-22T04:04:28.485ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39212024-11-22T04:04:28.485ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39222024-11-22T04:04:28.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39232024-11-22T04:04:28.486ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39242024-11-22T04:04:28.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39252024-11-22T04:04:28.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 54.231662ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39262024-11-22T04:04:28.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39272024-11-22T04:04:28.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39282024-11-22T04:04:28.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39292024-11-22T04:04:28.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39302024-11-22T04:04:28.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.321054ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
39312024-11-22T04:04:28.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.035136ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39322024-11-22T04:04:28.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39332024-11-22T04:04:28.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
39342024-11-22T04:04:28.503ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39352024-11-22T04:04:28.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39362024-11-22T04:04:28.553ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39372024-11-22T04:04:28.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39382024-11-22T04:04:28.560ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.990085ms iteration = 22 status = {"physical_disks_added":0}
39392024-11-22T04:04:28.575ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
39402024-11-22T04:04:28.575ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39412024-11-22T04:04:28.575ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e190b86-ac5d-4a68-a664-9fa7f0f72c5e", "content-length": "26", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
39422024-11-22T04:04:28.575ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39432024-11-22T04:04:28.577ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
39442024-11-22T04:04:28.596ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
39452024-11-22T04:04:28.596ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39462024-11-22T04:04:28.597ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e484b536-2071-42c9-b579-d53cae8c0360", "content-length": "372", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
39472024-11-22T04:04:28.597ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39482024-11-22T04:04:28.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39492024-11-22T04:04:28.599ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39502024-11-22T04:04:28.600ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39512024-11-22T04:04:28.600ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39522024-11-22T04:04:28.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39532024-11-22T04:04:28.600ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39542024-11-22T04:04:28.601ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 162.544785ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
39552024-11-22T04:04:28.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39562024-11-22T04:04:28.609ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39572024-11-22T04:04:28.609ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39582024-11-22T04:04:28.610ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39592024-11-22T04:04:28.613ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39602024-11-22T04:04:28.613ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39612024-11-22T04:04:28.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39622024-11-22T04:04:28.615ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39632024-11-22T04:04:28.616ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
39642024-11-22T04:04:28.616ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 178.043969ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
39652024-11-22T04:04:28.616ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
39662024-11-22T04:04:28.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39672024-11-22T04:04:28.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39682024-11-22T04:04:28.633ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39692024-11-22T04:04:28.634ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 195.742383ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
39702024-11-22T04:04:28.635ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39712024-11-22T04:04:28.635ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39722024-11-22T04:04:28.635ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 197.052017ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39732024-11-22T04:04:28.637ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
39742024-11-22T04:04:28.637ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39752024-11-22T04:04:28.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39762024-11-22T04:04:28.639ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 200.61503ms iteration = 20 status = 0
39772024-11-22T04:04:28.644ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
39782024-11-22T04:04:28.644ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39792024-11-22T04:04:28.644ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "31b74b32-4f33-4670-a101-cc32b1b59ee8", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
39802024-11-22T04:04:28.645ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39812024-11-22T04:04:28.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39822024-11-22T04:04:28.647ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39832024-11-22T04:04:28.647ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39842024-11-22T04:04:28.654ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39852024-11-22T04:04:28.654ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39862024-11-22T04:04:28.655ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b114480-03be-4c41-9a79-bb8b4520b3e0", "content-length": "26", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
39872024-11-22T04:04:28.655ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39882024-11-22T04:04:28.657ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39892024-11-22T04:04:28.657ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39902024-11-22T04:04:28.657ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39912024-11-22T04:04:28.666ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
39922024-11-22T04:04:28.666ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39932024-11-22T04:04:28.667ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2045c4f9-a209-4a65-894a-d5cee3e1d52f", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
39942024-11-22T04:04:28.669ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 230.430809ms iteration = 20 status = {}
39952024-11-22T04:04:28.671ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
39962024-11-22T04:04:28.671ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39972024-11-22T04:04:28.671ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "65fcfd17-ba62-4f20-9953-93cff2ac8454", "content-length": "26", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
39982024-11-22T04:04:28.671ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39992024-11-22T04:04:28.673ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
40002024-11-22T04:04:28.751ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40012024-11-22T04:04:28.751ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e2dba4f9-57d5-474d-90f1-b116484ca7fb", "content-length": "691", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
40022024-11-22T04:04:28.751ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40032024-11-22T04:04:28.751ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40042024-11-22T04:04:28.751ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40052024-11-22T04:04:28.753ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 314.688854ms iteration = 20 status = {}
40062024-11-22T04:04:28.763ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
40072024-11-22T04:04:28.763ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d11affcc-b174-4c29-9546-d6f511d1f22c", "content-length": "1", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
40082024-11-22T04:04:28.765ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40092024-11-22T04:04:28.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40102024-11-22T04:04:28.767ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.389524ms iteration = 20 status = null
40112024-11-22T04:04:28.781ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 343.435193ms iteration = 20 status = {}
40122024-11-22T04:04:28.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40132024-11-22T04:04:28.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40142024-11-22T04:04:28.820ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
40152024-11-22T04:04:28.820ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40162024-11-22T04:04:28.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40172024-11-22T04:04:28.829ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
40182024-11-22T04:04:28.830ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "744a64f0-a0a4-4f90-8e11-863e6b229698", "content-length": "134", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
40192024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40202024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
40212024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40222024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40232024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40242024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40252024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40262024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40272024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40282024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40292024-11-22T04:04:28.830ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
40302024-11-22T04:04:28.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40312024-11-22T04:04:28.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40322024-11-22T04:04:28.832ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
40332024-11-22T04:04:28.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c31b7ab-6be8-48ed-bc86-1e3dafea5101", "content-length": "2", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
40342024-11-22T04:04:28.833ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
40352024-11-22T04:04:28.833ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2457f5cd-b042-4f99-8e1f-045daccea45c", "content-length": "52", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
40362024-11-22T04:04:28.833ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
40372024-11-22T04:04:28.833ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40382024-11-22T04:04:28.922ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "ff360dd4-6b3d-40ea-b48d-6a06b8051a2c", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
40392024-11-22T04:04:28.922ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
40402024-11-22T04:04:28.922ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40412024-11-22T04:04:28.922ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c450221-bec0-4e65-9f97-5d374a0d6a08", "content-length": "682", "date": "Fri, 22 Nov 2024 04:04:28 GMT"} })
40422024-11-22T04:04:28.922ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40432024-11-22T04:04:28.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40442024-11-22T04:04:28.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40452024-11-22T04:04:28.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40462024-11-22T04:04:28.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40472024-11-22T04:04:28.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40482024-11-22T04:04:28.932ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40492024-11-22T04:04:28.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40502024-11-22T04:04:28.940ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.980716ms iteration = 20 status = {}
40512024-11-22T04:04:29.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 7281725b-c4b6-43c6-b462-0c70fb64351e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
40522024-11-22T04:04:29.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 7281725b-c4b6-43c6-b462-0c70fb64351e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
40532024-11-22T04:04:29.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3205 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 7281725b-c4b6-43c6-b462-0c70fb64351e response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
40542024-11-22T04:04:29.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 411dda14-8c51-4156-a947-bdfa63055800 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40552024-11-22T04:04:29.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 411dda14-8c51-4156-a947-bdfa63055800 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40562024-11-22T04:04:29.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1804 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 411dda14-8c51-4156-a947-bdfa63055800 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40572024-11-22T04:04:30.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 97345d8a-bf13-4500-be17-8112392b1521 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40582024-11-22T04:04:30.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 97345d8a-bf13-4500-be17-8112392b1521 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40592024-11-22T04:04:30.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2488 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 97345d8a-bf13-4500-be17-8112392b1521 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40602024-11-22T04:04:30.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 496 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 444c5203-7ffb-4f51-bc61-d7d061d1a49b response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
40612024-11-22T04:04:31.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c1f621f-6d4e-4bba-adb8-c9a89cfb5d19 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40622024-11-22T04:04:31.492ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c1f621f-6d4e-4bba-adb8-c9a89cfb5d19 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40632024-11-22T04:04:31.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2426 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c1f621f-6d4e-4bba-adb8-c9a89cfb5d19 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40642024-11-22T04:04:32.513ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a81dbe8-6919-4dd8-9146-bb92722ec76f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40652024-11-22T04:04:32.513ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a81dbe8-6919-4dd8-9146-bb92722ec76f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40662024-11-22T04:04:32.515ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1997 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a81dbe8-6919-4dd8-9146-bb92722ec76f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40672024-11-22T04:04:33.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 26eecd01-91aa-40bd-a1a7-6d7c567e87b8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40682024-11-22T04:04:33.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 26eecd01-91aa-40bd-a1a7-6d7c567e87b8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40692024-11-22T04:04:33.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 26eecd01-91aa-40bd-a1a7-6d7c567e87b8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40702024-11-22T04:04:34.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3774d0cb-b2bf-4b2b-95f3-35f1645de524 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40712024-11-22T04:04:34.554ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3774d0cb-b2bf-4b2b-95f3-35f1645de524 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40722024-11-22T04:04:34.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3774d0cb-b2bf-4b2b-95f3-35f1645de524 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40732024-11-22T04:04:35.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b2cf7330-45df-4fc7-b829-de5a230bbebe roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40742024-11-22T04:04:35.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b2cf7330-45df-4fc7-b829-de5a230bbebe resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40752024-11-22T04:04:35.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2964 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b2cf7330-45df-4fc7-b829-de5a230bbebe response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40762024-11-22T04:04:36.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 97b8fcee-6971-410c-93a9-6cc99fe7fec4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40772024-11-22T04:04:36.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 97b8fcee-6971-410c-93a9-6cc99fe7fec4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40782024-11-22T04:04:36.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2143 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 97b8fcee-6971-410c-93a9-6cc99fe7fec4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40792024-11-22T04:04:37.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a205f1ff-14d2-438f-83ce-d6f4aaa8219b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40802024-11-22T04:04:37.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a205f1ff-14d2-438f-83ce-d6f4aaa8219b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40812024-11-22T04:04:37.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a205f1ff-14d2-438f-83ce-d6f4aaa8219b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
40822024-11-22T04:04:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
40832024-11-22T04:04:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40842024-11-22T04:04:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
40852024-11-22T04:04:38.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40862024-11-22T04:04:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40872024-11-22T04:04:38.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40882024-11-22T04:04:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40892024-11-22T04:04:38.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40902024-11-22T04:04:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40912024-11-22T04:04:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40922024-11-22T04:04:38.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40932024-11-22T04:04:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40942024-11-22T04:04:38.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40952024-11-22T04:04:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40962024-11-22T04:04:38.469ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.398637ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40972024-11-22T04:04:38.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40982024-11-22T04:04:38.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
40992024-11-22T04:04:38.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41002024-11-22T04:04:38.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41012024-11-22T04:04:38.487ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
41022024-11-22T04:04:38.487ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.269195ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
41032024-11-22T04:04:38.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 187bd2d7-9761-466f-a28a-ee8efad79fcf roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41042024-11-22T04:04:38.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 187bd2d7-9761-466f-a28a-ee8efad79fcf resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41052024-11-22T04:04:38.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2158 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 187bd2d7-9761-466f-a28a-ee8efad79fcf response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41062024-11-22T04:04:39.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9785762b-e3b0-429d-9a79-1eca7f8bb57b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41072024-11-22T04:04:39.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9785762b-e3b0-429d-9a79-1eca7f8bb57b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41082024-11-22T04:04:39.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2076 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9785762b-e3b0-429d-9a79-1eca7f8bb57b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41092024-11-22T04:04:40.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 493 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 997f8128-1424-48ad-95e2-d9fe04074376 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
41102024-11-22T04:04:40.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fa89420a-501e-401c-b376-8055af81b87c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41112024-11-22T04:04:40.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fa89420a-501e-401c-b376-8055af81b87c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41122024-11-22T04:04:40.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fa89420a-501e-401c-b376-8055af81b87c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41132024-11-22T04:04:41.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ac17540a-5b54-4a59-bfd8-c96dd87e147b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41142024-11-22T04:04:41.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ac17540a-5b54-4a59-bfd8-c96dd87e147b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41152024-11-22T04:04:41.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ac17540a-5b54-4a59-bfd8-c96dd87e147b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41162024-11-22T04:04:42.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08501b6c-98b0-4df6-b921-5252c26150d9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41172024-11-22T04:04:42.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08501b6c-98b0-4df6-b921-5252c26150d9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41182024-11-22T04:04:42.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2202 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08501b6c-98b0-4df6-b921-5252c26150d9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41192024-11-22T04:04:43.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a682c72-ff63-4fc9-8ae3-a886dcc193b9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41202024-11-22T04:04:43.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a682c72-ff63-4fc9-8ae3-a886dcc193b9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41212024-11-22T04:04:43.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1954 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4a682c72-ff63-4fc9-8ae3-a886dcc193b9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41222024-11-22T04:04:44.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab2a911f-6b33-4ac0-a8af-2542e54dba24 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41232024-11-22T04:04:44.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab2a911f-6b33-4ac0-a8af-2542e54dba24 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41242024-11-22T04:04:44.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab2a911f-6b33-4ac0-a8af-2542e54dba24 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41252024-11-22T04:04:45.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df58d482-d210-48a1-b231-a217b3f920b5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41262024-11-22T04:04:45.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df58d482-d210-48a1-b231-a217b3f920b5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41272024-11-22T04:04:45.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2411 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = df58d482-d210-48a1-b231-a217b3f920b5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41282024-11-22T04:04:46.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 408b8f4c-8eb6-4649-8138-370075d56ff2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41292024-11-22T04:04:46.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 408b8f4c-8eb6-4649-8138-370075d56ff2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41302024-11-22T04:04:46.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 408b8f4c-8eb6-4649-8138-370075d56ff2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41312024-11-22T04:04:47.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 842d56b8-b14e-4c6c-abfd-6b33fe3bc9d2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41322024-11-22T04:04:47.836ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 842d56b8-b14e-4c6c-abfd-6b33fe3bc9d2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41332024-11-22T04:04:47.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 842d56b8-b14e-4c6c-abfd-6b33fe3bc9d2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41342024-11-22T04:04:48.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
41352024-11-22T04:04:48.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
41362024-11-22T04:04:48.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41372024-11-22T04:04:48.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41382024-11-22T04:04:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41392024-11-22T04:04:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41402024-11-22T04:04:48.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41412024-11-22T04:04:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41422024-11-22T04:04:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41432024-11-22T04:04:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41442024-11-22T04:04:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41452024-11-22T04:04:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41462024-11-22T04:04:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41472024-11-22T04:04:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41482024-11-22T04:04:48.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41492024-11-22T04:04:48.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
41502024-11-22T04:04:48.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41512024-11-22T04:04:48.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41522024-11-22T04:04:48.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
41532024-11-22T04:04:48.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.91915ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
41542024-11-22T04:04:48.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.296823ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41552024-11-22T04:04:48.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7eb62185-6033-4e6d-aa3c-a13c9ae0efd4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41562024-11-22T04:04:48.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7eb62185-6033-4e6d-aa3c-a13c9ae0efd4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41572024-11-22T04:04:48.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1922 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7eb62185-6033-4e6d-aa3c-a13c9ae0efd4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41582024-11-22T04:04:49.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7a4968a3-b8a7-4d38-8bcc-360180e9a217 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41592024-11-22T04:04:49.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7a4968a3-b8a7-4d38-8bcc-360180e9a217 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41602024-11-22T04:04:49.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2157 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7a4968a3-b8a7-4d38-8bcc-360180e9a217 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41612024-11-22T04:04:50.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 458 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 73c983f5-a067-47dc-aaf9-3ef3c79c1cba response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
41622024-11-22T04:04:50.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a93d0ec5-0e0e-4fb9-a396-cf70cbb63b1d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41632024-11-22T04:04:50.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a93d0ec5-0e0e-4fb9-a396-cf70cbb63b1d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41642024-11-22T04:04:50.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2045 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a93d0ec5-0e0e-4fb9-a396-cf70cbb63b1d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41652024-11-22T04:04:51.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 750d6399-258b-41e8-8fee-7c9c2e98b8f7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41662024-11-22T04:04:51.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 750d6399-258b-41e8-8fee-7c9c2e98b8f7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41672024-11-22T04:04:51.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1948 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 750d6399-258b-41e8-8fee-7c9c2e98b8f7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41682024-11-22T04:04:52.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = feb275d9-2a47-4c60-a956-e9e32cbd2e7f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41692024-11-22T04:04:52.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = feb275d9-2a47-4c60-a956-e9e32cbd2e7f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41702024-11-22T04:04:52.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = feb275d9-2a47-4c60-a956-e9e32cbd2e7f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41712024-11-22T04:04:53.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f4b6f628-620e-49ec-be0d-8e9a2fc26050 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41722024-11-22T04:04:53.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f4b6f628-620e-49ec-be0d-8e9a2fc26050 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41732024-11-22T04:04:53.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f4b6f628-620e-49ec-be0d-8e9a2fc26050 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41742024-11-22T04:04:54.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 85bf7115-ee2e-4563-95d4-a55d6baff3e7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41752024-11-22T04:04:54.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 85bf7115-ee2e-4563-95d4-a55d6baff3e7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41762024-11-22T04:04:54.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2404 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 85bf7115-ee2e-4563-95d4-a55d6baff3e7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41772024-11-22T04:04:55.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = a559a2d8-4827-4163-a912-cd84dea55de4 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
41782024-11-22T04:04:55.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = a559a2d8-4827-4163-a912-cd84dea55de4 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
41792024-11-22T04:04:55.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3119 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = a559a2d8-4827-4163-a912-cd84dea55de4 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
41802024-11-22T04:04:55.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 309b38df-f059-4c6d-911b-a75aa5c222f0 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
41812024-11-22T04:04:55.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 309b38df-f059-4c6d-911b-a75aa5c222f0 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
41822024-11-22T04:04:55.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:48388 req_id = 309b38df-f059-4c6d-911b-a75aa5c222f0 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
41832024-11-22T04:04:56.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0b65e745-f103-4efa-8129-41b990b59aaf roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41842024-11-22T04:04:56.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0b65e745-f103-4efa-8129-41b990b59aaf resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41852024-11-22T04:04:56.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2492 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0b65e745-f103-4efa-8129-41b990b59aaf response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41862024-11-22T04:04:57.027ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 143e10ab-4e03-49a6-923e-4887ef22d8c7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41872024-11-22T04:04:57.027ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 143e10ab-4e03-49a6-923e-4887ef22d8c7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41882024-11-22T04:04:57.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2004 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 143e10ab-4e03-49a6-923e-4887ef22d8c7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41892024-11-22T04:04:58.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9bbd0d3-5202-4e5e-9745-9119d3cf86b0 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41902024-11-22T04:04:58.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9bbd0d3-5202-4e5e-9745-9119d3cf86b0 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41912024-11-22T04:04:58.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2430 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9bbd0d3-5202-4e5e-9745-9119d3cf86b0 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
41922024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
41932024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41942024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
41952024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41962024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
41972024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
41982024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
41992024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
42002024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42012024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
42022024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
42032024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42042024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
42052024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42062024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42072024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
42082024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
42092024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42102024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
42112024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
42122024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42132024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
42142024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42152024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
42162024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
42172024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
42182024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42192024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42202024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
42212024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42222024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
42232024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
42242024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42252024-11-22T04:04:58.437ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:54:58.437844861 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42262024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42272024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
42282024-11-22T04:04:58.437ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
42292024-11-22T04:04:58.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
42302024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
42312024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
42322024-11-22T04:04:58.438ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
42332024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
42342024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.331\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
42352024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42362024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
42372024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
42382024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42392024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42402024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42412024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
42422024-11-22T04:04:58.438ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42432024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42442024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
42452024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42462024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
42472024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
42482024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
42492024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
42502024-11-22T04:04:58.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42512024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
42522024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42532024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42542024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
42552024-11-22T04:04:58.438ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
42562024-11-22T04:04:58.438ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
42572024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
42582024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42592024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42602024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
42612024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42622024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42632024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42642024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42652024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42662024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
42672024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42682024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42692024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42702024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42712024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42722024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42732024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42742024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42752024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42762024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42772024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42782024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42792024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42802024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42812024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42822024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
42832024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42842024-11-22T04:04:58.438ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
42852024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42862024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42872024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42882024-11-22T04:04:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42892024-11-22T04:04:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 789851158 } })
42902024-11-22T04:04:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 789872068 } })
42912024-11-22T04:04:58.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
42922024-11-22T04:04:58.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.330154ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
42932024-11-22T04:04:58.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
42942024-11-22T04:04:58.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.358274ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
42952024-11-22T04:04:58.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 792263071 } })
42962024-11-22T04:04:58.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.558673ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
42972024-11-22T04:04:58.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
42982024-11-22T04:04:58.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 793583924 } })
42992024-11-22T04:04:58.442ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43002024-11-22T04:04:58.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43012024-11-22T04:04:58.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43022024-11-22T04:04:58.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43032024-11-22T04:04:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
43042024-11-22T04:04:58.444ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
43052024-11-22T04:04:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
43062024-11-22T04:04:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43072024-11-22T04:04:58.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43082024-11-22T04:04:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43092024-11-22T04:04:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43102024-11-22T04:04:58.446ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43112024-11-22T04:04:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43122024-11-22T04:04:58.447ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43132024-11-22T04:04:58.447ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:54:58.437844861 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43142024-11-22T04:04:58.447ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 9.992697ms iteration = 11 status = {"expiration":"2024-11-22T03:54:58.437844861Z","pruned":[]}
43152024-11-22T04:04:58.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43162024-11-22T04:04:58.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43172024-11-22T04:04:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43182024-11-22T04:04:58.450ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43192024-11-22T04:04:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43202024-11-22T04:04:58.450ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43212024-11-22T04:04:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43222024-11-22T04:04:58.452ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.215702ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
43232024-11-22T04:04:58.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43242024-11-22T04:04:58.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43252024-11-22T04:04:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43262024-11-22T04:04:58.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43272024-11-22T04:04:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43282024-11-22T04:04:58.455ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43292024-11-22T04:04:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43302024-11-22T04:04:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43312024-11-22T04:04:58.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43322024-11-22T04:04:58.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43332024-11-22T04:04:58.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43342024-11-22T04:04:58.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43352024-11-22T04:04:58.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43362024-11-22T04:04:58.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43372024-11-22T04:04:58.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43382024-11-22T04:04:58.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43392024-11-22T04:04:58.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43402024-11-22T04:04:58.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43412024-11-22T04:04:58.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43422024-11-22T04:04:58.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43432024-11-22T04:04:58.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43442024-11-22T04:04:58.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43452024-11-22T04:04:58.468ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 819667457 } })
43462024-11-22T04:04:58.468ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
43472024-11-22T04:04:58.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43482024-11-22T04:04:58.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43492024-11-22T04:04:58.471ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(bb2be25a-161c-4a9e-afdb-30d5a08edeee, 0), (6c59157c-1820-48b8-8044-cd51eb815200, 0), (4acd1600-55b8-4488-9f7a-07f60d3e75ac, 0)]
43502024-11-22T04:04:58.471ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1527, tv_nsec: 823133569 } })
43512024-11-22T04:04:58.489ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43522024-11-22T04:04:58.489ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43532024-11-22T04:04:58.489ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43542024-11-22T04:04:58.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43552024-11-22T04:04:58.492ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43562024-11-22T04:04:58.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43572024-11-22T04:04:58.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43582024-11-22T04:04:58.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43592024-11-22T04:04:58.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43602024-11-22T04:04:58.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43612024-11-22T04:04:58.494ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43622024-11-22T04:04:58.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43632024-11-22T04:04:58.496ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43642024-11-22T04:04:58.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 58.956006ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
43652024-11-22T04:04:58.499ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43662024-11-22T04:04:58.499ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43672024-11-22T04:04:58.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43682024-11-22T04:04:58.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43692024-11-22T04:04:58.501ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43702024-11-22T04:04:58.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43712024-11-22T04:04:58.501ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43722024-11-22T04:04:58.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43732024-11-22T04:04:58.502ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43742024-11-22T04:04:58.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43752024-11-22T04:04:58.503ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43762024-11-22T04:04:58.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.421051ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43772024-11-22T04:04:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
43782024-11-22T04:04:58.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43792024-11-22T04:04:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43802024-11-22T04:04:58.505ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
43812024-11-22T04:04:58.505ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
43822024-11-22T04:04:58.505ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 67.6002ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
43832024-11-22T04:04:58.507ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.647686ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43842024-11-22T04:04:58.507ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.717317ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43852024-11-22T04:04:58.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43862024-11-22T04:04:58.508ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.696665ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
43872024-11-22T04:04:58.508ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43882024-11-22T04:04:58.508ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43892024-11-22T04:04:58.508ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43902024-11-22T04:04:58.508ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43912024-11-22T04:04:58.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43922024-11-22T04:04:58.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43932024-11-22T04:04:58.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43942024-11-22T04:04:58.510ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
43952024-11-22T04:04:58.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
43962024-11-22T04:04:58.511ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43972024-11-22T04:04:58.511ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 73.885851ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
43982024-11-22T04:04:58.512ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43992024-11-22T04:04:58.513ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44002024-11-22T04:04:58.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44012024-11-22T04:04:58.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44022024-11-22T04:04:58.517ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44032024-11-22T04:04:58.517ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44042024-11-22T04:04:58.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44052024-11-22T04:04:58.518ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44062024-11-22T04:04:58.518ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44072024-11-22T04:04:58.518ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
44082024-11-22T04:04:58.518ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.530209ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
44092024-11-22T04:04:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44102024-11-22T04:04:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44112024-11-22T04:04:58.518ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44122024-11-22T04:04:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44132024-11-22T04:04:58.521ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44142024-11-22T04:04:58.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44152024-11-22T04:04:58.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44162024-11-22T04:04:58.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44172024-11-22T04:04:58.528ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44182024-11-22T04:04:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44192024-11-22T04:04:58.533ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44202024-11-22T04:04:58.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44212024-11-22T04:04:58.536ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44222024-11-22T04:04:58.536ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44232024-11-22T04:04:58.538ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44242024-11-22T04:04:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44252024-11-22T04:04:58.540ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44262024-11-22T04:04:58.540ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44272024-11-22T04:04:58.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44282024-11-22T04:04:58.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44292024-11-22T04:04:58.543ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44302024-11-22T04:04:58.546ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
44312024-11-22T04:04:58.546ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44322024-11-22T04:04:58.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44332024-11-22T04:04:58.550ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 112.868023ms iteration = 21 status = 0
44342024-11-22T04:04:58.560ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44352024-11-22T04:04:58.560ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44362024-11-22T04:04:58.560ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.897411ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44372024-11-22T04:04:58.562ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44382024-11-22T04:04:58.562ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44392024-11-22T04:04:58.562ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.53167ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44402024-11-22T04:04:58.564ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44412024-11-22T04:04:58.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44422024-11-22T04:04:58.565ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44432024-11-22T04:04:58.566ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44442024-11-22T04:04:58.566ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44452024-11-22T04:04:58.566ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44462024-11-22T04:04:58.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44472024-11-22T04:04:58.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44482024-11-22T04:04:58.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44492024-11-22T04:04:58.570ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44502024-11-22T04:04:58.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44512024-11-22T04:04:58.575ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44522024-11-22T04:04:58.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44532024-11-22T04:04:58.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44542024-11-22T04:04:58.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44552024-11-22T04:04:58.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44562024-11-22T04:04:58.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44572024-11-22T04:04:58.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44582024-11-22T04:04:58.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44592024-11-22T04:04:58.581ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 143.939774ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44602024-11-22T04:04:58.582ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44612024-11-22T04:04:58.582ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44622024-11-22T04:04:58.582ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44632024-11-22T04:04:58.582ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44642024-11-22T04:04:58.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44652024-11-22T04:04:58.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44662024-11-22T04:04:58.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44672024-11-22T04:04:58.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44682024-11-22T04:04:58.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44692024-11-22T04:04:58.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44702024-11-22T04:04:58.586ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44712024-11-22T04:04:58.587ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44722024-11-22T04:04:58.587ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44732024-11-22T04:04:58.587ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44742024-11-22T04:04:58.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44752024-11-22T04:04:58.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44762024-11-22T04:04:58.589ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44772024-11-22T04:04:58.590ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
44782024-11-22T04:04:58.590ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44792024-11-22T04:04:58.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44802024-11-22T04:04:58.591ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44812024-11-22T04:04:58.591ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44822024-11-22T04:04:58.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44832024-11-22T04:04:58.592ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44842024-11-22T04:04:58.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44852024-11-22T04:04:58.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44862024-11-22T04:04:58.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44872024-11-22T04:04:58.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44882024-11-22T04:04:58.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44892024-11-22T04:04:58.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44902024-11-22T04:04:58.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44912024-11-22T04:04:58.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44922024-11-22T04:04:58.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44932024-11-22T04:04:58.602ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44942024-11-22T04:04:58.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44952024-11-22T04:04:58.603ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44962024-11-22T04:04:58.608ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
44972024-11-22T04:04:58.608ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
44982024-11-22T04:04:58.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
44992024-11-22T04:04:58.610ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45002024-11-22T04:04:58.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45012024-11-22T04:04:58.613ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
45022024-11-22T04:04:58.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
45032024-11-22T04:04:58.616ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45042024-11-22T04:04:58.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45052024-11-22T04:04:58.619ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45062024-11-22T04:04:58.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45072024-11-22T04:04:58.619ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45082024-11-22T04:04:58.620ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2c11d4a-eb08-4e38-9690-fb939df4a745", "content-length": "26", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45092024-11-22T04:04:58.620ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45102024-11-22T04:04:58.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45112024-11-22T04:04:58.622ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45122024-11-22T04:04:58.622ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45132024-11-22T04:04:58.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45142024-11-22T04:04:58.626ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45152024-11-22T04:04:58.626ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
45162024-11-22T04:04:58.626ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45172024-11-22T04:04:58.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45182024-11-22T04:04:58.630ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
45192024-11-22T04:04:58.630ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 192.093118ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
45202024-11-22T04:04:58.638ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 200.680881ms iteration = 23 status = {"physical_disks_added":0}
45212024-11-22T04:04:58.643ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) }
45222024-11-22T04:04:58.643ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 205.822282ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45232024-11-22T04:04:58.651ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45242024-11-22T04:04:58.651ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 213.521599ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45252024-11-22T04:04:58.659ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
45262024-11-22T04:04:58.659ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
45272024-11-22T04:04:58.659ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
45282024-11-22T04:04:58.659ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "a7eee39e-6368-443a-9ce2-527ad9d5cd38", "content-length": "476", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45292024-11-22T04:04:58.659ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
45302024-11-22T04:04:58.659ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45312024-11-22T04:04:58.660ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe8d33a9-1158-4bda-9f86-5d4a772f52d6", "content-length": "734", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45322024-11-22T04:04:58.660ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
45332024-11-22T04:04:58.660ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a089e881-f9f6-415a-9c3a-e1fc869dfc2a", "content-length": "111", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45342024-11-22T04:04:58.660ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
45352024-11-22T04:04:58.660ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "15723d0d-3735-4751-8f3a-5e3b921a004a", "content-length": "111", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45362024-11-22T04:04:58.661ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
45372024-11-22T04:04:58.661ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ff07a55-26d8-4c19-98d5-78188f543765", "content-length": "167", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45382024-11-22T04:04:58.661ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
45392024-11-22T04:04:58.661ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2b4fb14-fccb-4ee4-8144-835179e1045f", "content-length": "167", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45402024-11-22T04:04:58.661ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
45412024-11-22T04:04:58.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "981181b9-82cc-4c14-9d5a-d003ae3ef407", "content-length": "175", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45422024-11-22T04:04:58.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
45432024-11-22T04:04:58.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5113bf97-4e9a-4672-9f8d-dedaf99b39d1", "content-length": "175", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45442024-11-22T04:04:58.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
45452024-11-22T04:04:58.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1a3c624-3202-4465-a8fd-19b83c3288ff", "content-length": "702", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45462024-11-22T04:04:58.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
45472024-11-22T04:04:58.662ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "88b7250e-8fb6-4a89-ad44-0eb93f968a5a", "content-length": "727", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45482024-11-22T04:04:58.662ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
45492024-11-22T04:04:58.663ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6ce0ea4-89a1-4722-ba47-72148c79b4b6", "content-length": "729", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45502024-11-22T04:04:58.663ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
45512024-11-22T04:04:58.663ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7626681f-94bc-44bb-893e-23295ae9b6fd", "content-length": "728", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45522024-11-22T04:04:58.663ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
45532024-11-22T04:04:58.663ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4031c7a-bdb9-4b03-8f5c-611b11950240", "content-length": "722", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45542024-11-22T04:04:58.663ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
45552024-11-22T04:04:58.667ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "12aa45e9-3f40-4c42-b5b6-2e478eee0e47", "content-length": "109", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45562024-11-22T04:04:58.667ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
45572024-11-22T04:04:58.669ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "39f9f860-f3d4-4bc5-90a2-a9ab01f29be2", "content-length": "109", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45582024-11-22T04:04:58.669ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
45592024-11-22T04:04:58.670ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e1f6cc0-d8b8-44d7-82ff-ca230d858c4c", "content-length": "169", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45602024-11-22T04:04:58.670ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
45612024-11-22T04:04:58.670ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "dea9bceb-d669-4c97-9e6d-031239f84c95", "content-length": "169", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45622024-11-22T04:04:58.670ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
45632024-11-22T04:04:58.670ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "13f83f49-b818-44ea-93b0-82c183d7ce7c", "content-length": "178", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45642024-11-22T04:04:58.670ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
45652024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdf51a69-4e74-4e8a-9517-1561eff845e0", "content-length": "178", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45662024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
45672024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "14f7a751-2cd9-4056-808a-f8fca2b038f8", "content-length": "702", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45682024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45692024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e601cbc-7326-41ff-9375-41e2ce863853", "content-length": "727", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45702024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45712024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b282ad1-1044-426e-aade-73d3e1afe8e4", "content-length": "729", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45722024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
45732024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7aab10c-7685-4421-9af3-c5c490096ff7", "content-length": "728", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45742024-11-22T04:04:58.671ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
45752024-11-22T04:04:58.672ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
45762024-11-22T04:04:58.696ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
45772024-11-22T04:04:58.696ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45782024-11-22T04:04:58.697ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68a2809e-d848-4838-883d-2ac07ce7ebd8", "content-length": "26", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45792024-11-22T04:04:58.697ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45802024-11-22T04:04:58.699ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
45812024-11-22T04:04:58.754ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45822024-11-22T04:04:58.754ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45832024-11-22T04:04:58.755ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c828a44a-4245-4409-b5a3-b7ca1023f143", "content-length": "26", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
45842024-11-22T04:04:58.755ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45852024-11-22T04:04:58.756ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45862024-11-22T04:04:58.769ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45872024-11-22T04:04:58.819ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45882024-11-22T04:04:58.819ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45892024-11-22T04:04:58.821ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45902024-11-22T04:04:58.822ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45912024-11-22T04:04:58.822ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45922024-11-22T04:04:58.823ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45932024-11-22T04:04:58.823ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45942024-11-22T04:04:58.823ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45952024-11-22T04:04:58.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45962024-11-22T04:04:58.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45972024-11-22T04:04:58.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45982024-11-22T04:04:58.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45992024-11-22T04:04:58.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46002024-11-22T04:04:58.827ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46012024-11-22T04:04:58.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46022024-11-22T04:04:58.828ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
46032024-11-22T04:04:58.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46042024-11-22T04:04:58.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46052024-11-22T04:04:58.830ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46062024-11-22T04:04:58.830ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46072024-11-22T04:04:58.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46082024-11-22T04:04:58.832ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
46092024-11-22T04:04:58.832ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46102024-11-22T04:04:58.832ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
46112024-11-22T04:04:58.832ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 393.98273ms iteration = 11 status = {"generation":2}
46122024-11-22T04:04:58.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
46132024-11-22T04:04:58.833ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
46142024-11-22T04:04:58.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
46152024-11-22T04:04:58.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46162024-11-22T04:04:58.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
46172024-11-22T04:04:58.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46182024-11-22T04:04:58.835ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
46192024-11-22T04:04:58.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46202024-11-22T04:04:58.835ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46212024-11-22T04:04:58.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46222024-11-22T04:04:58.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46232024-11-22T04:04:58.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46242024-11-22T04:04:58.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
46252024-11-22T04:04:58.837ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
46262024-11-22T04:04:58.838ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46272024-11-22T04:04:58.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
46282024-11-22T04:04:58.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46292024-11-22T04:04:58.838ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
46302024-11-22T04:04:58.838ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
46312024-11-22T04:04:58.838ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
46322024-11-22T04:04:58.838ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 400.69456ms iteration = 11 status = {"generation":1}
46332024-11-22T04:04:58.840ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46342024-11-22T04:04:58.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46352024-11-22T04:04:58.916ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 478.531291ms iteration = 21 status = {}
46362024-11-22T04:04:58.938ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "adea04b4-05a9-45dc-a98e-026118d534a8", "content-length": "372", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
46372024-11-22T04:04:58.938ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46382024-11-22T04:04:58.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46392024-11-22T04:04:58.969ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
46402024-11-22T04:04:58.970ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "acb26e45-1d7a-4882-97fa-fe70a05428b7", "content-length": "1", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
46412024-11-22T04:04:58.971ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46422024-11-22T04:04:58.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46432024-11-22T04:04:58.992ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
46442024-11-22T04:04:58.992ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f3f9ef52-4983-40af-8c1b-b0fe2d63e631", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46452024-11-22T04:04:58.992ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46462024-11-22T04:04:58.995ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "be905bb8-65ad-4c11-a1f5-953900423aa3", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46472024-11-22T04:04:58.995ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46482024-11-22T04:04:58.997ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
46492024-11-22T04:04:58.997ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 560.131628ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
46502024-11-22T04:04:59.006ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
46512024-11-22T04:04:59.006ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
46522024-11-22T04:04:59.007ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "b62047c9-7b4f-4362-a542-9f5325a4cb73", "content-length": "691", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
46532024-11-22T04:04:59.007ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
46542024-11-22T04:04:59.007ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
46552024-11-22T04:04:59.007ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
46562024-11-22T04:04:59.009ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46572024-11-22T04:04:59.009ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 571.935038ms iteration = 21 status = null
46582024-11-22T04:04:59.009ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 571.889988ms iteration = 21 status = {}
46592024-11-22T04:04:59.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46602024-11-22T04:04:59.024ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
46612024-11-22T04:04:59.024ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
46622024-11-22T04:04:59.024ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fbfea1a9-a742-433b-8a39-a15bcbc14b51", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
46632024-11-22T04:04:59.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46642024-11-22T04:04:59.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46652024-11-22T04:04:59.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5f630e56-2b5f-4161-9c26-5e9d43cb0f50 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
46662024-11-22T04:04:59.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5f630e56-2b5f-4161-9c26-5e9d43cb0f50 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
46672024-11-22T04:04:59.133ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46682024-11-22T04:04:59.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46692024-11-22T04:04:59.136ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
46702024-11-22T04:04:59.136ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
46712024-11-22T04:04:59.138ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46722024-11-22T04:04:59.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46732024-11-22T04:04:59.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46742024-11-22T04:04:59.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46752024-11-22T04:04:59.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67311 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5f630e56-2b5f-4161-9c26-5e9d43cb0f50 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
46762024-11-22T04:04:59.140ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
46772024-11-22T04:04:59.140ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46782024-11-22T04:04:59.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46792024-11-22T04:04:59.141ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46802024-11-22T04:04:59.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46812024-11-22T04:04:59.143ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46822024-11-22T04:04:59.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46832024-11-22T04:04:59.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46842024-11-22T04:04:59.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46852024-11-22T04:04:59.145ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46862024-11-22T04:04:59.146ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
46872024-11-22T04:04:59.146ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
46882024-11-22T04:04:59.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
46892024-11-22T04:04:59.149ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46902024-11-22T04:04:59.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
46912024-11-22T04:04:59.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
46922024-11-22T04:04:59.149ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "49347974-1d78-4a40-9dfc-ebb8652b1bc3", "content-length": "134", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
46932024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46942024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
46952024-11-22T04:04:59.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
46962024-11-22T04:04:59.149ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "12ef88ac-5952-488d-8e1d-d150e14902d4", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46972024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
46982024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46992024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
47002024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47012024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47022024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47032024-11-22T04:04:59.149ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47042024-11-22T04:04:59.150ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
47052024-11-22T04:04:59.150ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
47062024-11-22T04:04:59.150ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
47072024-11-22T04:04:59.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47082024-11-22T04:04:59.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47092024-11-22T04:04:59.150ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dc018f3a-5d19-4344-a9e8-70c40abf005b", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
47102024-11-22T04:04:59.151ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47112024-11-22T04:04:59.151ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d08c761b-2885-4a23-bb66-2b624f723e4a", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
47122024-11-22T04:04:59.151ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
47132024-11-22T04:04:59.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47142024-11-22T04:04:59.152ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
47152024-11-22T04:04:59.152ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b7eea92d-d18e-4351-80db-25a68181f170", "content-length": "2", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
47162024-11-22T04:04:59.152ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
47172024-11-22T04:04:59.152ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d567b3e-111f-411d-a621-0ea4c9668ce4", "content-length": "52", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
47182024-11-22T04:04:59.152ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
47192024-11-22T04:04:59.152ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
47202024-11-22T04:04:59.155ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 717.921889ms iteration = 21 status = {}
47212024-11-22T04:04:59.155ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47222024-11-22T04:04:59.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47232024-11-22T04:04:59.157ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "18e3f4b0-5610-4176-861d-58bd9fe5e152", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
47242024-11-22T04:04:59.157ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
47252024-11-22T04:04:59.157ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47262024-11-22T04:04:59.159ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
47272024-11-22T04:04:59.159ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 721.859119ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
47282024-11-22T04:04:59.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
47292024-11-22T04:04:59.161ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47302024-11-22T04:04:59.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47312024-11-22T04:04:59.169ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
47322024-11-22T04:04:59.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47332024-11-22T04:04:59.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47342024-11-22T04:04:59.170ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47352024-11-22T04:04:59.172ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
47362024-11-22T04:04:59.172ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47372024-11-22T04:04:59.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47382024-11-22T04:04:59.174ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
47392024-11-22T04:04:59.174ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 2abf54e3-2c6c-44eb-b0e3-3fc421a14a03, kind: Service { id: bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b }, name: Name("external-dns-bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 102])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 93f11b6b-2dce-465c-b2b0-dad36b7143b0, kind: Service { id: da108ce4-fade-4cd8-8ba2-9af291527495 }, name: Name("external-dns-da108ce4-fade-4cd8-8ba2-9af291527495"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 188, 34])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 33ae9477-921f-41c3-9ac3-5632e24c2bfe, kind: Service { id: 8af2b85f-6ab3-4781-9033-075825f48255 }, name: Name("nexus-8af2b85f-6ab3-4781-9033-075825f48255"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 233])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 6d6f13dd-aee1-4596-bad2-e4f9d9529231, kind: Service { id: da73a142-bb8b-46e7-9b17-ceac40c41577 }, name: Name("nexus-da73a142-bb8b-46e7-9b17-ceac40c41577"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 222, 183])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 941af30c-f81b-4662-9f74-f275a9cf5c7d, kind: Service { id: 7c7e9efe-c39f-4953-97de-f8eafd979b1a }, name: Name("nexus-7c7e9efe-c39f-4953-97de-f8eafd979b1a"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 199, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
47402024-11-22T04:04:59.174ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
47412024-11-22T04:04:59.224ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: fcd04c0f-1471-4403-b8d9-fe281f829465, time_created: 2024-11-22T03:55:06.763171Z, time_modified: 2024-11-22T03:55:06.763171Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
47422024-11-22T04:04:59.224ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
47432024-11-22T04:04:59.224ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47442024-11-22T04:04:59.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47452024-11-22T04:04:59.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
47462024-11-22T04:04:59.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
47472024-11-22T04:04:59.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47482024-11-22T04:04:59.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
47492024-11-22T04:04:59.265ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
47502024-11-22T04:04:59.265ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "e173f09d-ef14-441f-8451-801c6179903e", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
47512024-11-22T04:04:59.267ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
47522024-11-22T04:04:59.267ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 829.283295ms
47532024-11-22T04:04:59.267ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 829.295395ms iteration = 3 status = {}
47542024-11-22T04:04:59.267ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "76e63cdf-8a2b-4ef6-a0eb-64f302585135", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
47552024-11-22T04:04:59.267ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
47562024-11-22T04:04:59.267ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
47572024-11-22T04:04:59.267ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1462a10f-846a-43ae-9660-7f024c7b612f", "content-length": "682", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
47582024-11-22T04:04:59.267ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47592024-11-22T04:04:59.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47602024-11-22T04:04:59.271ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47612024-11-22T04:04:59.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47622024-11-22T04:04:59.275ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47632024-11-22T04:04:59.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47642024-11-22T04:04:59.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47652024-11-22T04:04:59.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47662024-11-22T04:04:59.286ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 848.227381ms iteration = 21 status = {}
47672024-11-22T04:04:59.370ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1817b7f-5a10-4116-ba71-f23b501040ab", "content-length": "30760", "date": "Fri, 22 Nov 2024 04:04:58 GMT"} })
47682024-11-22T04:04:59.373ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
47692024-11-22T04:04:59.373ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
47702024-11-22T04:04:59.373ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
47712024-11-22T04:04:59.375ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47722024-11-22T04:04:59.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
47732024-11-22T04:04:59.376ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47742024-11-22T04:04:59.378ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
47752024-11-22T04:04:59.378ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
47762024-11-22T04:04:59.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
47772024-11-22T04:04:59.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 7772e68a-4cb3-4d5b-8906-23c90368b705 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
47782024-11-22T04:04:59.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 7772e68a-4cb3-4d5b-8906-23c90368b705 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
47792024-11-22T04:04:59.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3781 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 7772e68a-4cb3-4d5b-8906-23c90368b705 response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
47802024-11-22T04:04:59.558ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 55431b05-5e1b-4ba9-9472-8d4bb7cb2e77 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
47812024-11-22T04:04:59.558ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 55431b05-5e1b-4ba9-9472-8d4bb7cb2e77 time_started = 2024-11-22 04:04:58.659350 UTC
47822024-11-22T04:04:59.558ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.120538833s iteration = 3 status = {"collection_id":"55431b05-5e1b-4ba9-9472-8d4bb7cb2e77","time_done":"2024-11-22 04:04:59.373242 UTC","time_started":"2024-11-22 04:04:58.659350 UTC"}
47832024-11-22T04:04:59.558ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
47842024-11-22T04:04:59.558ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47852024-11-22T04:04:59.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47862024-11-22T04:04:59.560ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47872024-11-22T04:04:59.561ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47882024-11-22T04:04:59.561ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47892024-11-22T04:04:59.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47902024-11-22T04:04:59.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47912024-11-22T04:04:59.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47922024-11-22T04:04:59.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47932024-11-22T04:04:59.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47942024-11-22T04:04:59.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47952024-11-22T04:04:59.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47962024-11-22T04:04:59.628ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 69.782289ms iteration = 24 status = {"physical_disks_added":0}
47972024-11-22T04:05:00.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 05941108-e661-4d17-b2f3-f52545ec8103 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
47982024-11-22T04:05:00.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 05941108-e661-4d17-b2f3-f52545ec8103 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
47992024-11-22T04:05:00.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2183 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 05941108-e661-4d17-b2f3-f52545ec8103 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48002024-11-22T04:05:00.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 625 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 5a632ed0-91ba-4fb8-8a4a-9579ef3207a4 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
48012024-11-22T04:05:01.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 33fd8d33-659d-468b-923f-457230ae29e9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48022024-11-22T04:05:01.210ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 33fd8d33-659d-468b-923f-457230ae29e9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48032024-11-22T04:05:01.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2236 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 33fd8d33-659d-468b-923f-457230ae29e9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48042024-11-22T04:05:02.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 56868093-4737-42c6-889f-14690d5c7fb5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48052024-11-22T04:05:02.230ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 56868093-4737-42c6-889f-14690d5c7fb5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48062024-11-22T04:05:02.232ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1843 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 56868093-4737-42c6-889f-14690d5c7fb5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48072024-11-22T04:05:03.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eb1e634b-c9c2-4653-99a6-593a14e42200 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48082024-11-22T04:05:03.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eb1e634b-c9c2-4653-99a6-593a14e42200 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48092024-11-22T04:05:03.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = eb1e634b-c9c2-4653-99a6-593a14e42200 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48102024-11-22T04:05:04.272ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24a45e94-940a-4120-8f90-b50e398f5ee9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48112024-11-22T04:05:04.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24a45e94-940a-4120-8f90-b50e398f5ee9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48122024-11-22T04:05:04.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24a45e94-940a-4120-8f90-b50e398f5ee9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48132024-11-22T04:05:05.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a8d4c69-32e5-4426-a79f-d52858cfb36a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48142024-11-22T04:05:05.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a8d4c69-32e5-4426-a79f-d52858cfb36a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48152024-11-22T04:05:05.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2136 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a8d4c69-32e5-4426-a79f-d52858cfb36a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48162024-11-22T04:05:06.314ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ca68c981-3b5b-4246-8425-82a4cb500cd9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48172024-11-22T04:05:06.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ca68c981-3b5b-4246-8425-82a4cb500cd9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48182024-11-22T04:05:06.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ca68c981-3b5b-4246-8425-82a4cb500cd9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48192024-11-22T04:05:07.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2ae12260-c105-4b70-b36d-9e7821ba95f4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48202024-11-22T04:05:07.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2ae12260-c105-4b70-b36d-9e7821ba95f4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48212024-11-22T04:05:07.340ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2249 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2ae12260-c105-4b70-b36d-9e7821ba95f4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48222024-11-22T04:05:08.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 277ae370-73c8-4067-875d-72c51cd6eee8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48232024-11-22T04:05:08.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 277ae370-73c8-4067-875d-72c51cd6eee8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48242024-11-22T04:05:08.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 277ae370-73c8-4067-875d-72c51cd6eee8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48252024-11-22T04:05:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
48262024-11-22T04:05:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
48272024-11-22T04:05:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48282024-11-22T04:05:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48292024-11-22T04:05:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48302024-11-22T04:05:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48312024-11-22T04:05:08.439ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48322024-11-22T04:05:08.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48332024-11-22T04:05:08.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48342024-11-22T04:05:08.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.210717ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48352024-11-22T04:05:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48362024-11-22T04:05:08.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48372024-11-22T04:05:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48382024-11-22T04:05:08.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48392024-11-22T04:05:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48402024-11-22T04:05:08.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48412024-11-22T04:05:08.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
48422024-11-22T04:05:08.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48432024-11-22T04:05:08.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48442024-11-22T04:05:08.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
48452024-11-22T04:05:08.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.096639ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
48462024-11-22T04:05:09.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 75ff55cb-a3aa-452a-908f-b63b3a8ed792 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48472024-11-22T04:05:09.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 75ff55cb-a3aa-452a-908f-b63b3a8ed792 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48482024-11-22T04:05:09.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1836 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 75ff55cb-a3aa-452a-908f-b63b3a8ed792 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48492024-11-22T04:05:10.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 53dd6df7-5780-43bb-8017-fd1883b737f6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48502024-11-22T04:05:10.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 53dd6df7-5780-43bb-8017-fd1883b737f6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48512024-11-22T04:05:10.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1990 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 53dd6df7-5780-43bb-8017-fd1883b737f6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48522024-11-22T04:05:10.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 26ad9f89-888b-46d9-a79c-7337c9a80f54 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
48532024-11-22T04:05:11.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6ea33358-9f6b-402a-89e9-98318fe49786 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48542024-11-22T04:05:11.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6ea33358-9f6b-402a-89e9-98318fe49786 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48552024-11-22T04:05:11.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2027 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6ea33358-9f6b-402a-89e9-98318fe49786 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48562024-11-22T04:05:12.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b7f1c5b0-f8e1-42bc-9f63-76deae64d704 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48572024-11-22T04:05:12.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b7f1c5b0-f8e1-42bc-9f63-76deae64d704 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48582024-11-22T04:05:12.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1746 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b7f1c5b0-f8e1-42bc-9f63-76deae64d704 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48592024-11-22T04:05:13.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b15aa2c6-30fb-40e8-a12c-96e7f2ca2788 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48602024-11-22T04:05:13.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b15aa2c6-30fb-40e8-a12c-96e7f2ca2788 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48612024-11-22T04:05:13.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1890 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b15aa2c6-30fb-40e8-a12c-96e7f2ca2788 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48622024-11-22T04:05:14.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 329a7579-2993-42c7-a6fe-228cbb54c334 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48632024-11-22T04:05:14.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 329a7579-2993-42c7-a6fe-228cbb54c334 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48642024-11-22T04:05:14.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2557 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 329a7579-2993-42c7-a6fe-228cbb54c334 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48652024-11-22T04:05:15.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 610740ac-c983-4db0-8e5c-ab64d78ec620 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48662024-11-22T04:05:15.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 610740ac-c983-4db0-8e5c-ab64d78ec620 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48672024-11-22T04:05:15.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2374 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 610740ac-c983-4db0-8e5c-ab64d78ec620 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48682024-11-22T04:05:16.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d24ecbf2-5be6-4ff0-a4eb-d69f546929c7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48692024-11-22T04:05:16.531ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d24ecbf2-5be6-4ff0-a4eb-d69f546929c7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48702024-11-22T04:05:16.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d24ecbf2-5be6-4ff0-a4eb-d69f546929c7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48712024-11-22T04:05:17.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18ee1137-75b2-49b9-bae1-bc925a47e245 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48722024-11-22T04:05:17.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18ee1137-75b2-49b9-bae1-bc925a47e245 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48732024-11-22T04:05:17.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18ee1137-75b2-49b9-bae1-bc925a47e245 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48742024-11-22T04:05:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
48752024-11-22T04:05:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
48762024-11-22T04:05:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48772024-11-22T04:05:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48782024-11-22T04:05:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48792024-11-22T04:05:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48802024-11-22T04:05:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48812024-11-22T04:05:18.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48822024-11-22T04:05:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48832024-11-22T04:05:18.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.010941ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48842024-11-22T04:05:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48852024-11-22T04:05:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48862024-11-22T04:05:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48872024-11-22T04:05:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48882024-11-22T04:05:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48892024-11-22T04:05:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48902024-11-22T04:05:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
48912024-11-22T04:05:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48922024-11-22T04:05:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48932024-11-22T04:05:18.458ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
48942024-11-22T04:05:18.458ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.850572ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
48952024-11-22T04:05:18.574ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1766e769-74f0-4843-8802-562d32ec297d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48962024-11-22T04:05:18.575ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1766e769-74f0-4843-8802-562d32ec297d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48972024-11-22T04:05:18.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1788 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1766e769-74f0-4843-8802-562d32ec297d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48982024-11-22T04:05:19.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 67bb4c73-ebe0-49f5-9d91-5e8121852372 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
48992024-11-22T04:05:19.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 67bb4c73-ebe0-49f5-9d91-5e8121852372 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49002024-11-22T04:05:19.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2394 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 67bb4c73-ebe0-49f5-9d91-5e8121852372 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49012024-11-22T04:05:20.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18c9cb53-b083-4eed-8e21-903a7927c5cd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49022024-11-22T04:05:20.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18c9cb53-b083-4eed-8e21-903a7927c5cd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49032024-11-22T04:05:20.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2243 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18c9cb53-b083-4eed-8e21-903a7927c5cd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49042024-11-22T04:05:20.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 505 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = c8e68798-e311-49fa-ac1e-667e845e30f1 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
49052024-11-22T04:05:21.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0c6e3a9d-bf90-4352-a252-91731a29d994 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49062024-11-22T04:05:21.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0c6e3a9d-bf90-4352-a252-91731a29d994 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49072024-11-22T04:05:21.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1709 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0c6e3a9d-bf90-4352-a252-91731a29d994 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49082024-11-22T04:05:22.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1060d4e3-ea04-4f45-9aaf-54f14329fd68 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49092024-11-22T04:05:22.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1060d4e3-ea04-4f45-9aaf-54f14329fd68 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49102024-11-22T04:05:22.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1060d4e3-ea04-4f45-9aaf-54f14329fd68 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49112024-11-22T04:05:23.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d762c3f1-78bf-4e08-991d-abeaad38d74f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49122024-11-22T04:05:23.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d762c3f1-78bf-4e08-991d-abeaad38d74f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49132024-11-22T04:05:23.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2212 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d762c3f1-78bf-4e08-991d-abeaad38d74f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49142024-11-22T04:05:24.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c6478dd7-63d5-4fe4-a220-9f8bd30d5eed roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49152024-11-22T04:05:24.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c6478dd7-63d5-4fe4-a220-9f8bd30d5eed resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49162024-11-22T04:05:24.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2460 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c6478dd7-63d5-4fe4-a220-9f8bd30d5eed response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49172024-11-22T04:05:25.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9c6761d-65b8-4022-915b-0538c7b9bdd5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49182024-11-22T04:05:25.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9c6761d-65b8-4022-915b-0538c7b9bdd5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49192024-11-22T04:05:25.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9c6761d-65b8-4022-915b-0538c7b9bdd5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49202024-11-22T04:05:26.743ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6eade78-abdc-453c-8ace-2d01d5152434 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49212024-11-22T04:05:26.744ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6eade78-abdc-453c-8ace-2d01d5152434 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49222024-11-22T04:05:26.745ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1559 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a6eade78-abdc-453c-8ace-2d01d5152434 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49232024-11-22T04:05:27.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3dcbbcb-ce93-4ac9-a841-f5aaf42b1743 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49242024-11-22T04:05:27.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3dcbbcb-ce93-4ac9-a841-f5aaf42b1743 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49252024-11-22T04:05:27.768ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3dcbbcb-ce93-4ac9-a841-f5aaf42b1743 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
49262024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
49272024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49282024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
49292024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
49302024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
49312024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49322024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
49332024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
49342024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49352024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
49362024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49372024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
49382024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49392024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49402024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
49412024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49422024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
49432024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
49442024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
49452024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49462024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
49472024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49482024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
49492024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49502024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
49512024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49522024-11-22T04:05:28.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49532024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49542024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
49552024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49562024-11-22T04:05:28.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
49572024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49582024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
49592024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
49602024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
49612024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49622024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49632024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
49642024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49652024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
49662024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49672024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49682024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49692024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49702024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49712024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49722024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
49732024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49742024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49752024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49762024-11-22T04:05:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49772024-11-22T04:05:28.440ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1557, tv_nsec: 791939565 } })
49782024-11-22T04:05:28.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
49792024-11-22T04:05:28.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.313679ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49802024-11-22T04:05:28.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1557, tv_nsec: 792576426 } })
49812024-11-22T04:05:28.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
49822024-11-22T04:05:28.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49832024-11-22T04:05:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49842024-11-22T04:05:28.443ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49852024-11-22T04:05:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
49862024-11-22T04:05:28.444ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49872024-11-22T04:05:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49882024-11-22T04:05:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49892024-11-22T04:05:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49902024-11-22T04:05:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49912024-11-22T04:05:28.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49922024-11-22T04:05:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49932024-11-22T04:05:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49942024-11-22T04:05:28.446ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49952024-11-22T04:05:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49962024-11-22T04:05:28.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49972024-11-22T04:05:28.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49982024-11-22T04:05:28.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49992024-11-22T04:05:28.449ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50002024-11-22T04:05:28.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50012024-11-22T04:05:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50022024-11-22T04:05:28.452ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50032024-11-22T04:05:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50042024-11-22T04:05:28.452ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1557, tv_nsec: 804063020 } })
50052024-11-22T04:05:28.453ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
50062024-11-22T04:05:28.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50072024-11-22T04:05:28.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50082024-11-22T04:05:28.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50092024-11-22T04:05:28.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50102024-11-22T04:05:28.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50112024-11-22T04:05:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50122024-11-22T04:05:28.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50132024-11-22T04:05:28.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50142024-11-22T04:05:28.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50152024-11-22T04:05:28.459ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50162024-11-22T04:05:28.459ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50172024-11-22T04:05:28.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50182024-11-22T04:05:28.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50192024-11-22T04:05:28.460ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
50202024-11-22T04:05:28.460ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50212024-11-22T04:05:28.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50222024-11-22T04:05:28.476ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 38.536964ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
50232024-11-22T04:05:28.482ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
50242024-11-22T04:05:28.482ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 44.758095ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
50252024-11-22T04:05:28.482ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 45.298204ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
50262024-11-22T04:05:28.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50272024-11-22T04:05:28.486ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50282024-11-22T04:05:28.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50292024-11-22T04:05:28.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50302024-11-22T04:05:28.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50312024-11-22T04:05:28.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50322024-11-22T04:05:28.488ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50332024-11-22T04:05:28.488ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50342024-11-22T04:05:28.488ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50352024-11-22T04:05:28.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50362024-11-22T04:05:28.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50372024-11-22T04:05:28.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50382024-11-22T04:05:28.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50392024-11-22T04:05:28.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.359121ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50402024-11-22T04:05:28.490ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50412024-11-22T04:05:28.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50422024-11-22T04:05:28.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50432024-11-22T04:05:28.490ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.865798ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50442024-11-22T04:05:28.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50452024-11-22T04:05:28.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50462024-11-22T04:05:28.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50472024-11-22T04:05:28.492ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50482024-11-22T04:05:28.492ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50492024-11-22T04:05:28.492ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50502024-11-22T04:05:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50512024-11-22T04:05:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50522024-11-22T04:05:28.493ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50532024-11-22T04:05:28.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50542024-11-22T04:05:28.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50552024-11-22T04:05:28.495ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
50562024-11-22T04:05:28.495ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50572024-11-22T04:05:28.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50582024-11-22T04:05:28.496ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50592024-11-22T04:05:28.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50602024-11-22T04:05:28.503ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50612024-11-22T04:05:28.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.3893ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50622024-11-22T04:05:28.510ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50632024-11-22T04:05:28.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50642024-11-22T04:05:28.527ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50652024-11-22T04:05:28.527ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50662024-11-22T04:05:28.527ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.061468ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50672024-11-22T04:05:28.531ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.988328ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
50682024-11-22T04:05:28.549ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50692024-11-22T04:05:28.549ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50702024-11-22T04:05:28.549ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3921b7b3-9355-48a5-a9dc-e9bc9d24012f", "content-length": "26", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
50712024-11-22T04:05:28.549ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50722024-11-22T04:05:28.551ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50732024-11-22T04:05:28.551ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
50742024-11-22T04:05:28.551ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50752024-11-22T04:05:28.552ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b226cde-8e8e-4392-b971-bdafe1200d04", "content-length": "26", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
50762024-11-22T04:05:28.552ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50772024-11-22T04:05:28.553ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50782024-11-22T04:05:28.566ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
50792024-11-22T04:05:28.566ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50802024-11-22T04:05:28.567ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd3789f3-8dfa-4221-80d2-5e0d762130af", "content-length": "26", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
50812024-11-22T04:05:28.567ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50822024-11-22T04:05:28.568ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
50832024-11-22T04:05:28.573ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 135.349252ms iteration = 25 status = {"physical_disks_added":0}
50842024-11-22T04:05:28.664ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50852024-11-22T04:05:28.664ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50862024-11-22T04:05:28.664ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "077fa39b-287a-44c8-aedd-d497770b9b82", "content-length": "372", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
50872024-11-22T04:05:28.664ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50882024-11-22T04:05:28.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50892024-11-22T04:05:28.666ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 228.536065ms iteration = 22 status = 0
50902024-11-22T04:05:28.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50912024-11-22T04:05:28.667ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 229.749047ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
50922024-11-22T04:05:28.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50932024-11-22T04:05:28.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50942024-11-22T04:05:28.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50952024-11-22T04:05:28.670ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 232.984004ms iteration = 22 status = {}
50962024-11-22T04:05:28.679ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
50972024-11-22T04:05:28.679ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8eb085d5-3f50-4e84-a717-4a47d8923ed0", "content-length": "1", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
50982024-11-22T04:05:28.681ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50992024-11-22T04:05:28.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51002024-11-22T04:05:28.683ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 246.147918ms iteration = 22 status = null
51012024-11-22T04:05:28.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51022024-11-22T04:05:28.717ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
51032024-11-22T04:05:28.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51042024-11-22T04:05:28.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51052024-11-22T04:05:28.740ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
51062024-11-22T04:05:28.740ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
51072024-11-22T04:05:28.741ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "38c3b683-a475-4533-9445-d2420ef14399", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
51082024-11-22T04:05:28.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51092024-11-22T04:05:28.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51102024-11-22T04:05:28.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51112024-11-22T04:05:28.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51122024-11-22T04:05:28.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51132024-11-22T04:05:28.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51142024-11-22T04:05:28.753ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51152024-11-22T04:05:28.753ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51162024-11-22T04:05:28.753ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "68eca016-abc1-4ebd-a902-791ced872c77", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
51172024-11-22T04:05:28.755ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 317.32766ms iteration = 22 status = {}
51182024-11-22T04:05:28.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51192024-11-22T04:05:28.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51202024-11-22T04:05:28.774ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
51212024-11-22T04:05:28.774ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51222024-11-22T04:05:28.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51232024-11-22T04:05:28.784ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51242024-11-22T04:05:28.784ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7f8f869-ab22-462a-8bcf-b6f0aedff7f3", "content-length": "134", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
51252024-11-22T04:05:28.784ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51262024-11-22T04:05:28.784ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
51272024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51282024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51292024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51302024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51312024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51322024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51332024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51342024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51352024-11-22T04:05:28.785ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
51362024-11-22T04:05:28.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51372024-11-22T04:05:28.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51382024-11-22T04:05:28.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d96512a-1112-4ed7-8961-af944f443154 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51392024-11-22T04:05:28.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d96512a-1112-4ed7-8961-af944f443154 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51402024-11-22T04:05:28.787ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51412024-11-22T04:05:28.788ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "69451901-c131-43a4-abcd-f9a5240b8c20", "content-length": "2", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
51422024-11-22T04:05:28.788ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51432024-11-22T04:05:28.788ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "933617fc-2fe8-4fae-ab5b-b2f485f153db", "content-length": "52", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
51442024-11-22T04:05:28.788ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
51452024-11-22T04:05:28.788ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51462024-11-22T04:05:28.809ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51472024-11-22T04:05:28.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24485 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d96512a-1112-4ed7-8961-af944f443154 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51482024-11-22T04:05:28.883ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7b834313-add0-4a28-b207-fa31175f4928", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
51492024-11-22T04:05:28.883ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
51502024-11-22T04:05:28.883ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51512024-11-22T04:05:28.887ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0a3c4f4-864a-4d95-bd53-bd72388dc3fa", "content-length": "682", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
51522024-11-22T04:05:28.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51532024-11-22T04:05:28.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51542024-11-22T04:05:28.887ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "99c2b700-20bb-4583-a143-eb563b5c5307", "content-length": "691", "date": "Fri, 22 Nov 2024 04:05:28 GMT"} })
51552024-11-22T04:05:28.887ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
51562024-11-22T04:05:28.887ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
51572024-11-22T04:05:28.887ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
51582024-11-22T04:05:28.889ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 451.529841ms iteration = 22 status = {}
51592024-11-22T04:05:28.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51602024-11-22T04:05:28.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51612024-11-22T04:05:28.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51622024-11-22T04:05:28.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51632024-11-22T04:05:28.897ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51642024-11-22T04:05:28.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51652024-11-22T04:05:28.905ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 467.740509ms iteration = 22 status = {}
51662024-11-22T04:05:29.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 6e31501c-1e20-4a10-834c-219a4d5adbbc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
51672024-11-22T04:05:29.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 6e31501c-1e20-4a10-834c-219a4d5adbbc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
51682024-11-22T04:05:29.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5793 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 6e31501c-1e20-4a10-834c-219a4d5adbbc response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
51692024-11-22T04:05:29.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3cb3d745-52f5-4a4f-849b-ca0047ebd51b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51702024-11-22T04:05:29.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3cb3d745-52f5-4a4f-849b-ca0047ebd51b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51712024-11-22T04:05:29.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2387 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3cb3d745-52f5-4a4f-849b-ca0047ebd51b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51722024-11-22T04:05:30.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 584 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 3b4493ba-e9fa-4726-a638-9f735a87546f response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
51732024-11-22T04:05:30.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39e3c2e9-740d-489c-859b-26676ec6ba7f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51742024-11-22T04:05:30.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39e3c2e9-740d-489c-859b-26676ec6ba7f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51752024-11-22T04:05:30.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2086 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39e3c2e9-740d-489c-859b-26676ec6ba7f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51762024-11-22T04:05:31.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 48dba5d0-43e2-4b12-ab59-cabf353c47bf roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51772024-11-22T04:05:31.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 48dba5d0-43e2-4b12-ab59-cabf353c47bf resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51782024-11-22T04:05:31.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 48dba5d0-43e2-4b12-ab59-cabf353c47bf response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51792024-11-22T04:05:32.966ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7bbcbe59-7496-46f6-af2e-4e064dbf424b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51802024-11-22T04:05:32.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7bbcbe59-7496-46f6-af2e-4e064dbf424b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51812024-11-22T04:05:32.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7bbcbe59-7496-46f6-af2e-4e064dbf424b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51822024-11-22T04:05:33.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2df3e27-56e1-4dc4-a633-fadf39b13382 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51832024-11-22T04:05:33.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2df3e27-56e1-4dc4-a633-fadf39b13382 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51842024-11-22T04:05:33.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2330 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2df3e27-56e1-4dc4-a633-fadf39b13382 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51852024-11-22T04:05:35.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 64d86b84-a01f-4f04-9cc5-9a685086b27e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51862024-11-22T04:05:35.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 64d86b84-a01f-4f04-9cc5-9a685086b27e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51872024-11-22T04:05:35.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2547 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 64d86b84-a01f-4f04-9cc5-9a685086b27e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51882024-11-22T04:05:36.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 172a5fbc-ff77-426b-bceb-8891b1c71a41 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51892024-11-22T04:05:36.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 172a5fbc-ff77-426b-bceb-8891b1c71a41 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51902024-11-22T04:05:36.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 172a5fbc-ff77-426b-bceb-8891b1c71a41 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51912024-11-22T04:05:37.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c436806f-ef0e-4487-8187-31ee68c7923c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51922024-11-22T04:05:37.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c436806f-ef0e-4487-8187-31ee68c7923c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51932024-11-22T04:05:37.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c436806f-ef0e-4487-8187-31ee68c7923c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51942024-11-22T04:05:38.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 83daefc2-52fd-4ff1-a671-97bbcc2cc440 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51952024-11-22T04:05:38.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 83daefc2-52fd-4ff1-a671-97bbcc2cc440 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51962024-11-22T04:05:38.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2275 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 83daefc2-52fd-4ff1-a671-97bbcc2cc440 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
51972024-11-22T04:05:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
51982024-11-22T04:05:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51992024-11-22T04:05:38.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
52002024-11-22T04:05:38.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52012024-11-22T04:05:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52022024-11-22T04:05:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52032024-11-22T04:05:38.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52042024-11-22T04:05:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52052024-11-22T04:05:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52062024-11-22T04:05:38.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.50718ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52072024-11-22T04:05:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52082024-11-22T04:05:38.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52092024-11-22T04:05:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52102024-11-22T04:05:38.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52112024-11-22T04:05:38.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52122024-11-22T04:05:38.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52132024-11-22T04:05:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
52142024-11-22T04:05:38.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52152024-11-22T04:05:38.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52162024-11-22T04:05:38.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
52172024-11-22T04:05:38.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.190622ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
52182024-11-22T04:05:39.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0e92756e-e416-4bc2-8974-c7af0f561392 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52192024-11-22T04:05:39.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0e92756e-e416-4bc2-8974-c7af0f561392 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52202024-11-22T04:05:39.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0e92756e-e416-4bc2-8974-c7af0f561392 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52212024-11-22T04:05:40.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d9d6c2ac-aab1-4506-860b-4cb7d44ac805 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52222024-11-22T04:05:40.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d9d6c2ac-aab1-4506-860b-4cb7d44ac805 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52232024-11-22T04:05:40.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2307 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d9d6c2ac-aab1-4506-860b-4cb7d44ac805 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52242024-11-22T04:05:40.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 480 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = f4e0ed1c-ef61-4035-a63a-42a0c3ccf453 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
52252024-11-22T04:05:41.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 61ac631b-1ac0-410c-86a7-6c9c6a430356 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52262024-11-22T04:05:41.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 61ac631b-1ac0-410c-86a7-6c9c6a430356 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52272024-11-22T04:05:41.141ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2603 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 61ac631b-1ac0-410c-86a7-6c9c6a430356 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52282024-11-22T04:05:42.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d9ba3a55-a5ed-4d57-8011-dab5c9e337a5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52292024-11-22T04:05:42.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d9ba3a55-a5ed-4d57-8011-dab5c9e337a5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52302024-11-22T04:05:42.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2473 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d9ba3a55-a5ed-4d57-8011-dab5c9e337a5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52312024-11-22T04:05:43.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7b73e8a3-6484-4e74-8efe-91c44d6d136e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52322024-11-22T04:05:43.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7b73e8a3-6484-4e74-8efe-91c44d6d136e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52332024-11-22T04:05:43.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2260 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7b73e8a3-6484-4e74-8efe-91c44d6d136e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52342024-11-22T04:05:44.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 35759c5c-68a7-4bf3-8749-7aa9a83f1853 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52352024-11-22T04:05:44.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 35759c5c-68a7-4bf3-8749-7aa9a83f1853 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52362024-11-22T04:05:44.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1718 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 35759c5c-68a7-4bf3-8749-7aa9a83f1853 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52372024-11-22T04:05:45.226ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fd417e68-9b8c-48d6-9f10-45cc6447191a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52382024-11-22T04:05:45.227ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fd417e68-9b8c-48d6-9f10-45cc6447191a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52392024-11-22T04:05:45.228ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1678 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fd417e68-9b8c-48d6-9f10-45cc6447191a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52402024-11-22T04:05:46.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 853cff23-e212-485e-9f91-1a3d5e0b32aa roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52412024-11-22T04:05:46.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 853cff23-e212-485e-9f91-1a3d5e0b32aa resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52422024-11-22T04:05:46.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2240 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 853cff23-e212-485e-9f91-1a3d5e0b32aa response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52432024-11-22T04:05:47.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ca06b6f-0676-41c6-a73a-277f319fe4a2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52442024-11-22T04:05:47.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ca06b6f-0676-41c6-a73a-277f319fe4a2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52452024-11-22T04:05:47.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1904 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ca06b6f-0676-41c6-a73a-277f319fe4a2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52462024-11-22T04:05:48.290ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fe3a830d-066e-413a-aa9a-d4f4d49bc73b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52472024-11-22T04:05:48.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fe3a830d-066e-413a-aa9a-d4f4d49bc73b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52482024-11-22T04:05:48.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1911 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fe3a830d-066e-413a-aa9a-d4f4d49bc73b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52492024-11-22T04:05:48.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
52502024-11-22T04:05:48.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
52512024-11-22T04:05:48.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52522024-11-22T04:05:48.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52532024-11-22T04:05:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52542024-11-22T04:05:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52552024-11-22T04:05:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52562024-11-22T04:05:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52572024-11-22T04:05:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52582024-11-22T04:05:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52592024-11-22T04:05:48.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52602024-11-22T04:05:48.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52612024-11-22T04:05:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52622024-11-22T04:05:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
52632024-11-22T04:05:48.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52642024-11-22T04:05:48.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52652024-11-22T04:05:48.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
52662024-11-22T04:05:48.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.784463ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
52672024-11-22T04:05:48.470ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52682024-11-22T04:05:48.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52692024-11-22T04:05:48.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.925069ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52702024-11-22T04:05:49.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18f59d32-3298-4651-96bc-b468c9e8a747 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52712024-11-22T04:05:49.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18f59d32-3298-4651-96bc-b468c9e8a747 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52722024-11-22T04:05:49.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 18f59d32-3298-4651-96bc-b468c9e8a747 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52732024-11-22T04:05:50.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cd0776c4-0f5e-4761-bbe7-f8e1cc6862b7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52742024-11-22T04:05:50.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cd0776c4-0f5e-4761-bbe7-f8e1cc6862b7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52752024-11-22T04:05:50.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1713 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cd0776c4-0f5e-4761-bbe7-f8e1cc6862b7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52762024-11-22T04:05:50.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 475 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = ed409f40-0ecf-4da3-9eee-ad283715d4c3 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
52772024-11-22T04:05:51.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 69967456-4560-4e6c-8647-c38d63b86ce4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52782024-11-22T04:05:51.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 69967456-4560-4e6c-8647-c38d63b86ce4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52792024-11-22T04:05:51.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2429 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 69967456-4560-4e6c-8647-c38d63b86ce4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52802024-11-22T04:05:52.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0992e1c7-bbe4-4834-8300-9e883f7beea1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52812024-11-22T04:05:52.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0992e1c7-bbe4-4834-8300-9e883f7beea1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52822024-11-22T04:05:52.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2164 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0992e1c7-bbe4-4834-8300-9e883f7beea1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52832024-11-22T04:05:53.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b86f16b2-76a7-4023-a5c9-b6011e6d1bb2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52842024-11-22T04:05:53.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b86f16b2-76a7-4023-a5c9-b6011e6d1bb2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52852024-11-22T04:05:53.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b86f16b2-76a7-4023-a5c9-b6011e6d1bb2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52862024-11-22T04:05:54.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a40f22fa-0431-4b19-b0ce-4f5c8e0aaf62 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52872024-11-22T04:05:54.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a40f22fa-0431-4b19-b0ce-4f5c8e0aaf62 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52882024-11-22T04:05:54.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1660 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a40f22fa-0431-4b19-b0ce-4f5c8e0aaf62 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52892024-11-22T04:05:55.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1d3f0871-e811-4be4-a26a-1ad7ec7504a4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52902024-11-22T04:05:55.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1d3f0871-e811-4be4-a26a-1ad7ec7504a4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52912024-11-22T04:05:55.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1d3f0871-e811-4be4-a26a-1ad7ec7504a4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52922024-11-22T04:05:56.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2bad1656-5794-491b-ac01-a62880e2fbb7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52932024-11-22T04:05:56.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2bad1656-5794-491b-ac01-a62880e2fbb7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52942024-11-22T04:05:56.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2192 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2bad1656-5794-491b-ac01-a62880e2fbb7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52952024-11-22T04:05:57.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7fce02be-72b9-488e-9df8-e76930bd285d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52962024-11-22T04:05:57.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7fce02be-72b9-488e-9df8-e76930bd285d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52972024-11-22T04:05:57.485ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2721 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7fce02be-72b9-488e-9df8-e76930bd285d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
52982024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
52992024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
53002024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53012024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
53022024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
53032024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
53042024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53052024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
53062024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
53072024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
53082024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53092024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
53102024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53112024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
53122024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
53132024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
53142024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
53152024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53162024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53172024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
53182024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
53192024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
53202024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53212024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
53222024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
53232024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
53242024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
53252024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53262024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
53272024-11-22T04:05:58.437ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
53282024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53292024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
53302024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53312024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
53322024-11-22T04:05:58.437ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
53332024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53342024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53352024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
53362024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
53372024-11-22T04:05:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
53382024-11-22T04:05:58.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
53392024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.51\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
53402024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
53412024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
53422024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53432024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
53442024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
53452024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
53462024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53472024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
53482024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
53492024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
53502024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53512024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
53522024-11-22T04:05:58.438ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:55:58.437963342 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
53532024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
53542024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
53552024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
53562024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53572024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
53582024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
53592024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
53602024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53612024-11-22T04:05:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 789232287 } })
53622024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53632024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
53642024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53652024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53662024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53672024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
53682024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53692024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53702024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
53712024-11-22T04:05:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 789565633 } })
53722024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53732024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53742024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
53752024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53762024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53772024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
53782024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53792024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
53802024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
53812024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53822024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53832024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53842024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53852024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
53862024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
53872024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.371374ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
53882024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
53892024-11-22T04:05:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.069699ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
53902024-11-22T04:05:58.439ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53912024-11-22T04:05:58.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53922024-11-22T04:05:58.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53932024-11-22T04:05:58.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 794583992 } })
53942024-11-22T04:05:58.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
53952024-11-22T04:05:58.444ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.577856ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53962024-11-22T04:05:58.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53972024-11-22T04:05:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53982024-11-22T04:05:58.445ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53992024-11-22T04:05:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54002024-11-22T04:05:58.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 796843042 } })
54012024-11-22T04:05:58.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54022024-11-22T04:05:58.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54032024-11-22T04:05:58.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54042024-11-22T04:05:58.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54052024-11-22T04:05:58.455ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54062024-11-22T04:05:58.455ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54072024-11-22T04:05:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54082024-11-22T04:05:58.456ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.343775ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
54092024-11-22T04:05:58.457ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54102024-11-22T04:05:58.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54112024-11-22T04:05:58.457ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54122024-11-22T04:05:58.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54132024-11-22T04:05:58.457ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:55:58.437963342 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
54142024-11-22T04:05:58.457ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.818842ms iteration = 12 status = {"expiration":"2024-11-22T03:55:58.437963342Z","pruned":[]}
54152024-11-22T04:05:58.457ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54162024-11-22T04:05:58.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
54172024-11-22T04:05:58.461ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
54182024-11-22T04:05:58.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
54192024-11-22T04:05:58.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54202024-11-22T04:05:58.461ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54212024-11-22T04:05:58.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54222024-11-22T04:05:58.463ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54232024-11-22T04:05:58.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54242024-11-22T04:05:58.469ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54252024-11-22T04:05:58.469ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54262024-11-22T04:05:58.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54272024-11-22T04:05:58.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54282024-11-22T04:05:58.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54292024-11-22T04:05:58.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54302024-11-22T04:05:58.476ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54312024-11-22T04:05:58.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54322024-11-22T04:05:58.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54332024-11-22T04:05:58.479ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54342024-11-22T04:05:58.479ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54352024-11-22T04:05:58.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54362024-11-22T04:05:58.484ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54372024-11-22T04:05:58.487ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54382024-11-22T04:05:58.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54392024-11-22T04:05:58.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54402024-11-22T04:05:58.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54412024-11-22T04:05:58.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54422024-11-22T04:05:58.503ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54432024-11-22T04:05:58.503ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
54442024-11-22T04:05:58.503ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54452024-11-22T04:05:58.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54462024-11-22T04:05:58.504ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 66.865597ms iteration = 23 status = {"errors":[],"records_set_to_done":[]}
54472024-11-22T04:05:58.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d3c5ae65-88ec-46af-81c0-14ee6bedae94 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
54482024-11-22T04:05:58.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d3c5ae65-88ec-46af-81c0-14ee6bedae94 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
54492024-11-22T04:05:58.508ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54502024-11-22T04:05:58.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54512024-11-22T04:05:58.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54522024-11-22T04:05:58.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54532024-11-22T04:05:58.512ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.197277ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
54542024-11-22T04:05:58.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54552024-11-22T04:05:58.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54562024-11-22T04:05:58.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54572024-11-22T04:05:58.513ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
54582024-11-22T04:05:58.513ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
54592024-11-22T04:05:58.513ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 75.365827ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
54602024-11-22T04:05:58.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54612024-11-22T04:05:58.514ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54622024-11-22T04:05:58.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54632024-11-22T04:05:58.516ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9188 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d3c5ae65-88ec-46af-81c0-14ee6bedae94 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
54642024-11-22T04:05:58.516ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54652024-11-22T04:05:58.516ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
54662024-11-22T04:05:58.516ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
54672024-11-22T04:05:58.516ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.544493ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
54682024-11-22T04:05:58.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54692024-11-22T04:05:58.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54702024-11-22T04:05:58.517ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54712024-11-22T04:05:58.518ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54722024-11-22T04:05:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54732024-11-22T04:05:58.518ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1587, tv_nsec: 869425240 } })
54742024-11-22T04:05:58.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54752024-11-22T04:05:58.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.496309ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54762024-11-22T04:05:58.518ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
54772024-11-22T04:05:58.518ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54782024-11-22T04:05:58.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54792024-11-22T04:05:58.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54802024-11-22T04:05:58.522ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54812024-11-22T04:05:58.524ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54822024-11-22T04:05:58.524ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54832024-11-22T04:05:58.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54842024-11-22T04:05:58.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54852024-11-22T04:05:58.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54862024-11-22T04:05:58.526ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54872024-11-22T04:05:58.526ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54882024-11-22T04:05:58.526ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54892024-11-22T04:05:58.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54902024-11-22T04:05:58.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54912024-11-22T04:05:58.526ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54922024-11-22T04:05:58.527ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54932024-11-22T04:05:58.527ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54942024-11-22T04:05:58.529ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54952024-11-22T04:05:58.529ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54962024-11-22T04:05:58.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54972024-11-22T04:05:58.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
54982024-11-22T04:05:58.532ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54992024-11-22T04:05:58.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55002024-11-22T04:05:58.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55012024-11-22T04:05:58.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55022024-11-22T04:05:58.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55032024-11-22T04:05:58.533ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55042024-11-22T04:05:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55052024-11-22T04:05:58.543ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
55062024-11-22T04:05:58.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
55072024-11-22T04:05:58.545ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55082024-11-22T04:05:58.545ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55092024-11-22T04:05:58.545ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55102024-11-22T04:05:58.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55112024-11-22T04:05:58.548ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
55122024-11-22T04:05:58.548ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 110.433519ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
55132024-11-22T04:05:58.551ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55142024-11-22T04:05:58.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55152024-11-22T04:05:58.552ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 114.92553ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55162024-11-22T04:05:58.564ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 126.613666ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55172024-11-22T04:05:58.569ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
55182024-11-22T04:05:58.569ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
55192024-11-22T04:05:58.569ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
55202024-11-22T04:05:58.569ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55212024-11-22T04:05:58.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55222024-11-22T04:05:58.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.332027ms iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55232024-11-22T04:05:58.580ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
55242024-11-22T04:05:58.580ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
55252024-11-22T04:05:58.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55262024-11-22T04:05:58.580ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55272024-11-22T04:05:58.580ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 142.872376ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55282024-11-22T04:05:58.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55292024-11-22T04:05:58.589ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55302024-11-22T04:05:58.620ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.989207ms iteration = 26 status = {"physical_disks_added":0}
55312024-11-22T04:05:58.629ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55322024-11-22T04:05:58.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55332024-11-22T04:05:58.682ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55342024-11-22T04:05:58.683ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55352024-11-22T04:05:58.683ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcf91ca0-3474-45f9-91f6-fff1d83e0330", "content-length": "26", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
55362024-11-22T04:05:58.683ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55372024-11-22T04:05:58.685ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55382024-11-22T04:05:58.690ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
55392024-11-22T04:05:58.737ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
55402024-11-22T04:05:58.737ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55412024-11-22T04:05:58.738ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1d505f5-f6f3-4db4-bad4-f877f049195a", "content-length": "26", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
55422024-11-22T04:05:58.738ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55432024-11-22T04:05:58.740ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
55442024-11-22T04:05:58.758ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55452024-11-22T04:05:58.758ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55462024-11-22T04:05:58.764ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55472024-11-22T04:05:58.767ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55482024-11-22T04:05:58.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
55492024-11-22T04:05:58.768ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55502024-11-22T04:05:58.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55512024-11-22T04:05:58.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55522024-11-22T04:05:58.771ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55532024-11-22T04:05:58.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55542024-11-22T04:05:58.775ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 337.345665ms iteration = 23 status = 0
55552024-11-22T04:05:58.776ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55562024-11-22T04:05:58.776ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55572024-11-22T04:05:58.776ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
55582024-11-22T04:05:58.776ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 338.800261ms iteration = 12 status = {"generation":1}
55592024-11-22T04:05:58.785ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55602024-11-22T04:05:58.785ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55612024-11-22T04:05:58.785ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "477af35a-21f2-4a89-b870-aa6f3d60af1a", "content-length": "26", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
55622024-11-22T04:05:58.785ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55632024-11-22T04:05:58.787ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55642024-11-22T04:05:58.798ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55652024-11-22T04:05:58.801ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55662024-11-22T04:05:58.801ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55672024-11-22T04:05:58.801ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55682024-11-22T04:05:58.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55692024-11-22T04:05:58.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
55702024-11-22T04:05:58.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
55712024-11-22T04:05:58.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
55722024-11-22T04:05:58.808ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
55732024-11-22T04:05:58.808ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fa43b296-cfb4-407c-9425-27998f393d84", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55742024-11-22T04:05:58.808ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55752024-11-22T04:05:58.808ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55762024-11-22T04:05:58.808ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55772024-11-22T04:05:58.808ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 371.235746ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55782024-11-22T04:05:58.810ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "091c63f4-f39d-428a-822f-beb012fc91b2", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55792024-11-22T04:05:58.810ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55802024-11-22T04:05:58.811ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
55812024-11-22T04:05:58.811ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 373.970665ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55822024-11-22T04:05:58.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55832024-11-22T04:05:58.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55842024-11-22T04:05:58.825ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55852024-11-22T04:05:58.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55862024-11-22T04:05:58.834ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "49297d8a-6f5b-4435-ad6e-eb5ab6b7d2ea", "content-length": "372", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
55872024-11-22T04:05:58.834ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55882024-11-22T04:05:58.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55892024-11-22T04:05:58.848ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
55902024-11-22T04:05:58.848ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
55912024-11-22T04:05:58.848ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55922024-11-22T04:05:58.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55932024-11-22T04:05:58.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55942024-11-22T04:05:58.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
55952024-11-22T04:05:58.853ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
55962024-11-22T04:05:58.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
55972024-11-22T04:05:58.855ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
55982024-11-22T04:05:58.855ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
55992024-11-22T04:05:58.855ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
56002024-11-22T04:05:58.855ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 417.539768ms iteration = 12 status = {"generation":2}
56012024-11-22T04:05:58.858ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
56022024-11-22T04:05:58.858ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 420.632803ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
56032024-11-22T04:05:58.863ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56042024-11-22T04:05:58.865ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56052024-11-22T04:05:58.865ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56062024-11-22T04:05:58.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56072024-11-22T04:05:58.880ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
56082024-11-22T04:05:58.880ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
56092024-11-22T04:05:58.880ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b9f58d58-ee1a-401c-b467-1a797f7bd8ac", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
56102024-11-22T04:05:58.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56112024-11-22T04:05:58.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56122024-11-22T04:05:58.885ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
56132024-11-22T04:05:58.886ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56142024-11-22T04:05:58.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56152024-11-22T04:05:58.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56162024-11-22T04:05:58.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56172024-11-22T04:05:58.893ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
56182024-11-22T04:05:58.893ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 455.560893ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
56192024-11-22T04:05:58.893ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56202024-11-22T04:05:58.893ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56212024-11-22T04:05:58.894ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c8c22968-8261-48aa-af16-8cb395981ffc", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
56222024-11-22T04:05:58.896ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 458.399483ms iteration = 23 status = {}
56232024-11-22T04:05:58.912ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
56242024-11-22T04:05:58.913ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a519304-e911-43a3-88c3-11e5d4b75958", "content-length": "1", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
56252024-11-22T04:05:58.914ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56262024-11-22T04:05:58.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56272024-11-22T04:05:58.917ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 479.393226ms iteration = 23 status = null
56282024-11-22T04:05:58.924ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 486.534643ms iteration = 23 status = {}
56292024-11-22T04:05:58.957ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
56302024-11-22T04:05:58.957ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5d3e82dd-efa4-4161-9e39-4dc2a656bf78", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56312024-11-22T04:05:58.957ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56322024-11-22T04:05:58.959ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "63531f3b-804a-4890-ba15-aa829980c87f", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56332024-11-22T04:05:58.959ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56342024-11-22T04:05:58.961ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "19c6589a-13f3-4560-9188-2e7c5966e609", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56352024-11-22T04:05:58.961ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56362024-11-22T04:05:58.963ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
56372024-11-22T04:05:58.963ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 525.875141ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
56382024-11-22T04:05:59.000ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56392024-11-22T04:05:59.001ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "450d4359-4e23-4fd8-bc12-78dbea47afc4", "content-length": "691", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
56402024-11-22T04:05:59.001ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
56412024-11-22T04:05:59.001ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56422024-11-22T04:05:59.001ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56432024-11-22T04:05:59.003ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 565.535825ms iteration = 23 status = {}
56442024-11-22T04:05:59.029ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56452024-11-22T04:05:59.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56462024-11-22T04:05:59.032ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
56472024-11-22T04:05:59.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56482024-11-22T04:05:59.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56492024-11-22T04:05:59.041ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56502024-11-22T04:05:59.041ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdf04a32-7394-49dd-b7fc-12a7d83d2f48", "content-length": "134", "date": "Fri, 22 Nov 2024 04:05:59 GMT"} })
56512024-11-22T04:05:59.041ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56522024-11-22T04:05:59.041ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
56532024-11-22T04:05:59.041ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56542024-11-22T04:05:59.041ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56552024-11-22T04:05:59.041ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56562024-11-22T04:05:59.041ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56572024-11-22T04:05:59.041ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56582024-11-22T04:05:59.041ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56592024-11-22T04:05:59.042ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56602024-11-22T04:05:59.042ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56612024-11-22T04:05:59.042ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
56622024-11-22T04:05:59.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56632024-11-22T04:05:59.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56642024-11-22T04:05:59.045ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56652024-11-22T04:05:59.045ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9a8ee00-c681-4302-aa7d-5959c3c93e76", "content-length": "2", "date": "Fri, 22 Nov 2024 04:05:59 GMT"} })
56662024-11-22T04:05:59.045ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56672024-11-22T04:05:59.045ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f342a25a-b630-49cf-aa34-ab734c497c40", "content-length": "52", "date": "Fri, 22 Nov 2024 04:05:59 GMT"} })
56682024-11-22T04:05:59.045ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
56692024-11-22T04:05:59.045ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56702024-11-22T04:05:59.128ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9e322406-fae6-4ff5-b18b-0d352f4d0db8", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
56712024-11-22T04:05:59.128ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
56722024-11-22T04:05:59.128ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56732024-11-22T04:05:59.129ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3b41d32-b179-473c-8032-04b2a195b0da", "content-length": "682", "date": "Fri, 22 Nov 2024 04:05:58 GMT"} })
56742024-11-22T04:05:59.129ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56752024-11-22T04:05:59.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56762024-11-22T04:05:59.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56772024-11-22T04:05:59.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56782024-11-22T04:05:59.135ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56792024-11-22T04:05:59.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56802024-11-22T04:05:59.138ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56812024-11-22T04:05:59.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56822024-11-22T04:05:59.146ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 708.97136ms iteration = 23 status = {}
56832024-11-22T04:05:59.264ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
56842024-11-22T04:05:59.264ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
56852024-11-22T04:05:59.295ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
56862024-11-22T04:05:59.295ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:65475
56872024-11-22T04:05:59.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65475 req_id = f1a5c306-23fa-4c77-aa6e-e7870db5b163 roles = RoleSet { roles: {} } uri = /metrics/producers
56882024-11-22T04:05:59.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65475 req_id = f1a5c306-23fa-4c77-aa6e-e7870db5b163 resource = Database result = Ok(()) uri = /metrics/producers
56892024-11-22T04:05:59.329ZINFOnexus: assigned collector to new producer collector_id = 619dee3a-9d47-45ec-a665-d347c721dbd7 file = nexus/src/app/oximeter.rs:76 producer_id = 8af2b85f-6ab3-4781-9033-075825f48255
56902024-11-22T04:05:59.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33313 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:65475 req_id = f1a5c306-23fa-4c77-aa6e-e7870db5b163 response_code = 201 uri = /metrics/producers
56912024-11-22T04:05:59.329ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f1a5c306-23fa-4c77-aa6e-e7870db5b163", "content-length": "41", "date": "Fri, 22 Nov 2024 04:05:59 GMT"} })
56922024-11-22T04:05:59.331ZDEBGnexus (producer-registration-task): registered with nexus successfully
56932024-11-22T04:05:59.331ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
56942024-11-22T04:05:59.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 90950c33-01e3-4153-8685-17d60e7a52ac roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
56952024-11-22T04:05:59.541ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 90950c33-01e3-4153-8685-17d60e7a52ac resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
56962024-11-22T04:05:59.543ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 90950c33-01e3-4153-8685-17d60e7a52ac response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
56972024-11-22T04:05:59.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = edb0a4fd-0b55-43d6-90b0-c93467c543ef roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
56982024-11-22T04:05:59.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = edb0a4fd-0b55-43d6-90b0-c93467c543ef resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
56992024-11-22T04:05:59.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2846 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = edb0a4fd-0b55-43d6-90b0-c93467c543ef response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
57002024-11-22T04:06:00.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 07276605-b7ed-4e77-bf4e-6b3758e616c5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57012024-11-22T04:06:00.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 07276605-b7ed-4e77-bf4e-6b3758e616c5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57022024-11-22T04:06:00.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 07276605-b7ed-4e77-bf4e-6b3758e616c5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57032024-11-22T04:06:00.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 481 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 15e52e5f-12ae-45ec-bd3f-bccdb57d070a response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
57042024-11-22T04:06:01.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39676012-ea75-4833-a1ca-0ef11834863a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57052024-11-22T04:06:01.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39676012-ea75-4833-a1ca-0ef11834863a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57062024-11-22T04:06:01.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1885 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39676012-ea75-4833-a1ca-0ef11834863a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57072024-11-22T04:06:02.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2309e38a-4757-4fe5-b598-5dd4832e805b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57082024-11-22T04:06:02.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2309e38a-4757-4fe5-b598-5dd4832e805b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57092024-11-22T04:06:02.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2233 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2309e38a-4757-4fe5-b598-5dd4832e805b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57102024-11-22T04:06:03.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34b96183-fcd9-4eae-8e5b-1895c34544f9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57112024-11-22T04:06:03.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34b96183-fcd9-4eae-8e5b-1895c34544f9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57122024-11-22T04:06:03.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2423 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34b96183-fcd9-4eae-8e5b-1895c34544f9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57132024-11-22T04:06:04.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 55d005dc-2d58-4d88-90f2-d454c63a1bab roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
57142024-11-22T04:06:04.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 55d005dc-2d58-4d88-90f2-d454c63a1bab resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
57152024-11-22T04:06:04.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 55d005dc-2d58-4d88-90f2-d454c63a1bab response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
57162024-11-22T04:06:04.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 365b56f8-6c5c-43d3-932b-6d6ed995bc3e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
57172024-11-22T04:06:04.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 365b56f8-6c5c-43d3-932b-6d6ed995bc3e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
57182024-11-22T04:06:04.566ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5530 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 365b56f8-6c5c-43d3-932b-6d6ed995bc3e response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
57192024-11-22T04:06:04.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 87c3b60c-bf33-4af6-8ecb-4a6fe7641d83 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57202024-11-22T04:06:04.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 87c3b60c-bf33-4af6-8ecb-4a6fe7641d83 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57212024-11-22T04:06:04.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 87c3b60c-bf33-4af6-8ecb-4a6fe7641d83 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57222024-11-22T04:06:05.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9b9d641-54b6-4d89-9098-6d5e9fc5e7dd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57232024-11-22T04:06:05.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9b9d641-54b6-4d89-9098-6d5e9fc5e7dd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57242024-11-22T04:06:05.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2609 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e9b9d641-54b6-4d89-9098-6d5e9fc5e7dd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57252024-11-22T04:06:06.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bb2edca9-3596-4220-872d-659d001cdf4d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57262024-11-22T04:06:06.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bb2edca9-3596-4220-872d-659d001cdf4d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57272024-11-22T04:06:06.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bb2edca9-3596-4220-872d-659d001cdf4d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57282024-11-22T04:06:07.741ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c12a3720-7f85-42b1-be0d-16631677ca60 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57292024-11-22T04:06:07.741ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c12a3720-7f85-42b1-be0d-16631677ca60 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57302024-11-22T04:06:07.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c12a3720-7f85-42b1-be0d-16631677ca60 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57312024-11-22T04:06:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
57322024-11-22T04:06:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57332024-11-22T04:06:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
57342024-11-22T04:06:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57352024-11-22T04:06:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57362024-11-22T04:06:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57372024-11-22T04:06:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57382024-11-22T04:06:08.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57392024-11-22T04:06:08.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57402024-11-22T04:06:08.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57412024-11-22T04:06:08.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57422024-11-22T04:06:08.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57432024-11-22T04:06:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57442024-11-22T04:06:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
57452024-11-22T04:06:08.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57462024-11-22T04:06:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57472024-11-22T04:06:08.463ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
57482024-11-22T04:06:08.463ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.045114ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
57492024-11-22T04:06:08.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57502024-11-22T04:06:08.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57512024-11-22T04:06:08.496ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.467007ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57522024-11-22T04:06:08.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8a927c30-63aa-494d-ade0-164827d825df roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57532024-11-22T04:06:08.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8a927c30-63aa-494d-ade0-164827d825df resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57542024-11-22T04:06:08.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8a927c30-63aa-494d-ade0-164827d825df response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57552024-11-22T04:06:09.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 276da18d-0535-4f0e-a77d-39099b044440 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57562024-11-22T04:06:09.789ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 276da18d-0535-4f0e-a77d-39099b044440 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57572024-11-22T04:06:09.791ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2296 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 276da18d-0535-4f0e-a77d-39099b044440 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57582024-11-22T04:06:10.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 469 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 3fec5f5d-86e3-445f-81eb-0318cc621b43 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
57592024-11-22T04:06:10.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 872f8386-025b-414e-aa11-b930c035f7df roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57602024-11-22T04:06:10.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 872f8386-025b-414e-aa11-b930c035f7df resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57612024-11-22T04:06:10.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2341 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 872f8386-025b-414e-aa11-b930c035f7df response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57622024-11-22T04:06:11.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8fdcbeb1-04ac-4e7b-83bb-5ff40a555878 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57632024-11-22T04:06:11.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8fdcbeb1-04ac-4e7b-83bb-5ff40a555878 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57642024-11-22T04:06:11.838ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8fdcbeb1-04ac-4e7b-83bb-5ff40a555878 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57652024-11-22T04:06:11.957ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0a3d2756-a810-4131-81ed-7c0dcd9917dd uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2024-11-22T04:06:11.944802466Z }
57662024-11-22T04:06:11.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0a3d2756-a810-4131-81ed-7c0dcd9917dd roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
57672024-11-22T04:06:11.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0a3d2756-a810-4131-81ed-7c0dcd9917dd resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
57682024-11-22T04:06:11.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29756 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0a3d2756-a810-4131-81ed-7c0dcd9917dd response_code = 204 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
57692024-11-22T04:06:11.975ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2b56dcdf-a973-4d4f-b8cc-b64db417ebf9 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1 vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2024-11-22T04:06:11.975370179Z }
57702024-11-22T04:06:11.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2b56dcdf-a973-4d4f-b8cc-b64db417ebf9 roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
57712024-11-22T04:06:11.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2b56dcdf-a973-4d4f-b8cc-b64db417ebf9 resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
57722024-11-22T04:06:11.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8234 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2b56dcdf-a973-4d4f-b8cc-b64db417ebf9 response_code = 204 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
57732024-11-22T04:06:12.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2af9581-ae29-4381-b1bb-c33618079eb0 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57742024-11-22T04:06:12.858ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2af9581-ae29-4381-b1bb-c33618079eb0 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57752024-11-22T04:06:12.860ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2277 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2af9581-ae29-4381-b1bb-c33618079eb0 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57762024-11-22T04:06:13.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cbd41221-b4a2-4142-84bc-4b5852e2413d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57772024-11-22T04:06:13.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cbd41221-b4a2-4142-84bc-4b5852e2413d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57782024-11-22T04:06:13.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cbd41221-b4a2-4142-84bc-4b5852e2413d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57792024-11-22T04:06:14.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7be6cf38-1b9d-40dd-8f56-7fae5e4356f5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57802024-11-22T04:06:14.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7be6cf38-1b9d-40dd-8f56-7fae5e4356f5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57812024-11-22T04:06:14.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7be6cf38-1b9d-40dd-8f56-7fae5e4356f5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57822024-11-22T04:06:15.924ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2d975ac-d47c-41e2-8e4a-7d9f91d255d8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57832024-11-22T04:06:15.924ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2d975ac-d47c-41e2-8e4a-7d9f91d255d8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57842024-11-22T04:06:15.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2289 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e2d975ac-d47c-41e2-8e4a-7d9f91d255d8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57852024-11-22T04:06:16.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1460aad6-2a04-44d7-8689-70ef5a649afd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57862024-11-22T04:06:16.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1460aad6-2a04-44d7-8689-70ef5a649afd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57872024-11-22T04:06:16.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1460aad6-2a04-44d7-8689-70ef5a649afd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57882024-11-22T04:06:17.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a469e0b4-06eb-4831-957a-cba351986b93 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57892024-11-22T04:06:17.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a469e0b4-06eb-4831-957a-cba351986b93 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57902024-11-22T04:06:17.969ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a469e0b4-06eb-4831-957a-cba351986b93 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
57912024-11-22T04:06:18.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
57922024-11-22T04:06:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57932024-11-22T04:06:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
57942024-11-22T04:06:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57952024-11-22T04:06:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57962024-11-22T04:06:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57972024-11-22T04:06:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57982024-11-22T04:06:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
57992024-11-22T04:06:18.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58002024-11-22T04:06:18.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58012024-11-22T04:06:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58022024-11-22T04:06:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58032024-11-22T04:06:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58042024-11-22T04:06:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
58052024-11-22T04:06:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58062024-11-22T04:06:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58072024-11-22T04:06:18.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
58082024-11-22T04:06:18.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.207691ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
58092024-11-22T04:06:18.467ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58102024-11-22T04:06:18.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58112024-11-22T04:06:18.497ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.248871ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58122024-11-22T04:06:18.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0376d9f8-fb5f-4b2d-9a0e-2e01fa303bb8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58132024-11-22T04:06:18.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0376d9f8-fb5f-4b2d-9a0e-2e01fa303bb8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58142024-11-22T04:06:18.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2247 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0376d9f8-fb5f-4b2d-9a0e-2e01fa303bb8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58152024-11-22T04:06:20.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aaf04793-1c92-48cb-ba6b-a5a48e5cd9a5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58162024-11-22T04:06:20.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aaf04793-1c92-48cb-ba6b-a5a48e5cd9a5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58172024-11-22T04:06:20.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aaf04793-1c92-48cb-ba6b-a5a48e5cd9a5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58182024-11-22T04:06:20.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 617 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 9ed42642-7966-46f6-a7a5-585ff6011f1d response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
58192024-11-22T04:06:21.034ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e668faa-b7b8-47b6-92e1-b8466c2f1fbf roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58202024-11-22T04:06:21.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e668faa-b7b8-47b6-92e1-b8466c2f1fbf resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58212024-11-22T04:06:21.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1950 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e668faa-b7b8-47b6-92e1-b8466c2f1fbf response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58222024-11-22T04:06:21.496ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 986504d5-6506-4dff-9353-5faab5b34f9a uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2024-11-22T04:06:21.495918661Z }
58232024-11-22T04:06:21.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 986504d5-6506-4dff-9353-5faab5b34f9a roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58242024-11-22T04:06:21.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 986504d5-6506-4dff-9353-5faab5b34f9a resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58252024-11-22T04:06:21.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14590 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 986504d5-6506-4dff-9353-5faab5b34f9a response_code = 204 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58262024-11-22T04:06:22.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 25083fd9-39cf-401f-ad00-4ca70a6be13b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58272024-11-22T04:06:22.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 25083fd9-39cf-401f-ad00-4ca70a6be13b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58282024-11-22T04:06:22.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2625 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 25083fd9-39cf-401f-ad00-4ca70a6be13b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58292024-11-22T04:06:22.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 8f869290-9d13-441c-b753-e546be9e5fb2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/8?limit=100
58302024-11-22T04:06:22.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 8f869290-9d13-441c-b753-e546be9e5fb2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/8?limit=100
58312024-11-22T04:06:22.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 8f869290-9d13-441c-b753-e546be9e5fb2 response_code = 200 uri = /nat/ipv4/changeset/8?limit=100
58322024-11-22T04:06:22.587ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f3ef16cf-27dc-4a9d-a491-9cc6d5324033 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
58332024-11-22T04:06:22.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f3ef16cf-27dc-4a9d-a491-9cc6d5324033 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
58342024-11-22T04:06:22.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3168 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f3ef16cf-27dc-4a9d-a491-9cc6d5324033 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
58352024-11-22T04:06:23.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 47906778-8e42-471c-8dcc-a88997e7e9e0 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58362024-11-22T04:06:23.078ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 47906778-8e42-471c-8dcc-a88997e7e9e0 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58372024-11-22T04:06:23.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1528 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 47906778-8e42-471c-8dcc-a88997e7e9e0 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58382024-11-22T04:06:23.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 1ed31e09-c099-4196-9952-2ddd0fd779e3 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
58392024-11-22T04:06:23.592ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 1ed31e09-c099-4196-9952-2ddd0fd779e3 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
58402024-11-22T04:06:23.595ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3769 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 1ed31e09-c099-4196-9952-2ddd0fd779e3 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
58412024-11-22T04:06:23.900ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T04:06:23.899866187Z }
58422024-11-22T04:06:23.900ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58432024-11-22T04:06:23.900ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58442024-11-22T04:06:23.936ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1 vmm_needs_update = true
58452024-11-22T04:06:23.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58462024-11-22T04:06:23.937ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58472024-11-22T04:06:23.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58482024-11-22T04:06:23.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58492024-11-22T04:06:23.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58502024-11-22T04:06:23.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58512024-11-22T04:06:23.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58522024-11-22T04:06:23.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58532024-11-22T04:06:23.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58542024-11-22T04:06:23.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58552024-11-22T04:06:23.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58562024-11-22T04:06:23.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58572024-11-22T04:06:23.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58582024-11-22T04:06:23.953ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, lookup_type: ById(f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208) }, key: 3ac1be93-6287-4d44-9a76-4ff624883fe3, lookup_type: ById(3ac1be93-6287-4d44-9a76-4ff624883fe3) }, key: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537, lookup_type: ById(8c0a5ce4-0955-48e1-a1f1-3b7acf045537) } result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58592024-11-22T04:06:23.964ZINFOnexus (dropshot_internal): starting update saga for 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1583 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T04:06:23.899866187Z }
58602024-11-22T04:06:23.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66661 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 response_code = 204 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58612024-11-22T04:06:23.966ZDEBGnexus (dropshot_internal): preparing instance-update saga for 8c0a5ce4-0955-48e1-a1f1-3b7acf045537... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e8d8a50-61d8-469e-86a4-f6b60ff48832 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58622024-11-22T04:06:23.966ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update
58632024-11-22T04:06:23.967ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2116 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8ea99b24-0e7f-4fa7-aaba-6800657bb90e uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2024-11-22T04:06:23.899866187Z }
58642024-11-22T04:06:23.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8ea99b24-0e7f-4fa7-aaba-6800657bb90e roles = RoleSet { roles: {} } uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58652024-11-22T04:06:23.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8ea99b24-0e7f-4fa7-aaba-6800657bb90e resource = Database result = Ok(()) uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58662024-11-22T04:06:23.969ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"8c0a5ce4-0955-48e1-a1f1-3b7acf045537","lookup_type":{"ById":"8c0a5ce4-0955-48e1-a1f1-3b7acf045537"},"parent":{"key":"3ac1be93-6287-4d44-9a76-4ff624883fe3","lookup_type":{"ById":"3ac1be93-6287-4d44-9a76-4ff624883fe3"},"parent":{"key":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","lookup_type":{"ById":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
58672024-11-22T04:06:23.969ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update
58682024-11-22T04:06:23.973ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6659 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8ea99b24-0e7f-4fa7-aaba-6800657bb90e response_code = 204 uri = /vmms/ac35c2a3-f0ae-4a40-8af0-513950af66a1
58692024-11-22T04:06:24.010ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update
58702024-11-22T04:06:24.010ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
58712024-11-22T04:06:24.018ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
58722024-11-22T04:06:24.018ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
58732024-11-22T04:06:24.022ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
58742024-11-22T04:06:24.022ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
58752024-11-22T04:06:24.026ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
58762024-11-22T04:06:24.026ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
58772024-11-22T04:06:24.036ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
58782024-11-22T04:06:24.036ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("783dee84-54fe-4b5e-abe5-3c7b44449e51")) node_id = 0 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
58792024-11-22T04:06:24.040ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
58802024-11-22T04:06:24.040ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
58812024-11-22T04:06:24.051ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update
58822024-11-22T04:06:24.056ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58832024-11-22T04:06:24.056ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58842024-11-22T04:06:24.059ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58852024-11-22T04:06:24.059ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58862024-11-22T04:06:24.061ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58872024-11-22T04:06:24.061ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58882024-11-22T04:06:24.068ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58892024-11-22T04:06:24.068ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58902024-11-22T04:06:24.098ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58912024-11-22T04:06:24.098ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58922024-11-22T04:06:24.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 35364cf6-d0fe-4e46-8440-245970f4aab1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58932024-11-22T04:06:24.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 35364cf6-d0fe-4e46-8440-245970f4aab1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58942024-11-22T04:06:24.100ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58952024-11-22T04:06:24.100ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58962024-11-22T04:06:24.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 35364cf6-d0fe-4e46-8440-245970f4aab1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
58972024-11-22T04:06:24.101ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58982024-11-22T04:06:24.107ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, lookup_type: ById(f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208) }, key: 3ac1be93-6287-4d44-9a76-4ff624883fe3, lookup_type: ById(3ac1be93-6287-4d44-9a76-4ff624883fe3) }, key: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537, lookup_type: ById(8c0a5ce4-0955-48e1-a1f1-3b7acf045537) } result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
58992024-11-22T04:06:24.107ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance updater_id = 783dee84-54fe-4b5e-abe5-3c7b44449e51
59002024-11-22T04:06:24.107ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
59012024-11-22T04:06:24.107ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
59022024-11-22T04:06:24.123ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance updater_id = 783dee84-54fe-4b5e-abe5-3c7b44449e51
59032024-11-22T04:06:24.123ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
59042024-11-22T04:06:24.123ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance
59052024-11-22T04:06:24.127ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 locked_gen = Generation(Generation(2)) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = LockInstance updater_id = 783dee84-54fe-4b5e-abe5-3c7b44449e51
59062024-11-22T04:06:24.129ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59072024-11-22T04:06:24.129ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("783dee84-54fe-4b5e-abe5-3c7b44449e51")}) node_id = 1 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
59082024-11-22T04:06:24.133ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59092024-11-22T04:06:24.133ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
59102024-11-22T04:06:24.138ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59112024-11-22T04:06:24.139ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59122024-11-22T04:06:24.140ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59132024-11-22T04:06:24.140ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59142024-11-22T04:06:24.141ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59152024-11-22T04:06:24.141ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59162024-11-22T04:06:24.143ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59172024-11-22T04:06:24.146ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, lookup_type: ById(f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208) }, key: 3ac1be93-6287-4d44-9a76-4ff624883fe3, lookup_type: ById(3ac1be93-6287-4d44-9a76-4ff624883fe3) }, key: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537, lookup_type: ById(8c0a5ce4-0955-48e1-a1f1-3b7acf045537) } result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59182024-11-22T04:06:24.146ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59192024-11-22T04:06:24.146ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
59202024-11-22T04:06:24.151ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: ac35c2a3-f0ae-4a40-8af0-513950af66a1, time_created: 2024-11-22T04:06:03.286467Z, time_deleted: None, instance_id: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537, sled_id: fcd04c0f-1471-4403-b8d9-fe281f829465, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2024-11-22T04:06:23.899866Z, gen: Generation(Generation(8)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2024-11-22T04:06:01.163184Z, gen: Generation(Generation(3)), propolis_id: Some(ac35c2a3-f0ae-4a40-8af0-513950af66a1), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(ac35c2a3-f0ae-4a40-8af0-513950af66a1 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2024-11-22T04:06:24.151571073Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
59212024-11-22T04:06:24.159ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59222024-11-22T04:06:24.159ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"8c0a5ce4-0955-48e1-a1f1-3b7acf045537","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"ac35c2a3-f0ae-4a40-8af0-513950af66a1"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"8c0a5ce4-0955-48e1-a1f1-3b7acf045537","lookup_type":{"ById":"8c0a5ce4-0955-48e1-a1f1-3b7acf045537"},"parent":{"key":"3ac1be93-6287-4d44-9a76-4ff624883fe3","lookup_type":{"ById":"3ac1be93-6287-4d44-9a76-4ff624883fe3"},"parent":{"key":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","lookup_type":{"ById":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"783dee84-54fe-4b5e-abe5-3c7b44449e51"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"3ac1be93-6287-4d44-9a76-4ff624883fe3","ram_diff":1073741824},"destroy_active_vmm":"ac35c2a3-f0ae-4a40-8af0-513950af66a1","destroy_target_vmm":null,"network_config":"Delete","new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2024-11-22T04:06:24.151571073Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59232024-11-22T04:06:24.159ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59242024-11-22T04:06:24.188ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59252024-11-22T04:06:24.188ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59262024-11-22T04:06:24.188ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59272024-11-22T04:06:24.188ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59282024-11-22T04:06:24.192ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59292024-11-22T04:06:24.192ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59302024-11-22T04:06:24.196ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59312024-11-22T04:06:24.196ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59322024-11-22T04:06:24.199ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59332024-11-22T04:06:24.199ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("f2136669-a8f8-4242-9dc6-8dbcaac38ff6")) node_id = 0 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59342024-11-22T04:06:24.203ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59352024-11-22T04:06:24.203ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59362024-11-22T04:06:24.208ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 parent_lock = UpdaterLock { updater_id: 783dee84-54fe-4b5e-abe5-3c7b44449e51, locked_gen: Generation(Generation(2)) } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59372024-11-22T04:06:24.208ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = BecomeUpdater
59382024-11-22T04:06:24.209ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = BecomeUpdater
59392024-11-22T04:06:24.219ZDEBGnexus (SagaExecutor): inherited lock from 783dee84-54fe-4b5e-abe5-3c7b44449e51 to f2136669-a8f8-4242-9dc6-8dbcaac38ff6 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = 783dee84-54fe-4b5e-abe5-3c7b44449e51 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = BecomeUpdater updater_id = f2136669-a8f8-4242-9dc6-8dbcaac38ff6
59402024-11-22T04:06:24.219ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:964 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59412024-11-22T04:06:24.219ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59422024-11-22T04:06:24.219ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f2136669-a8f8-4242-9dc6-8dbcaac38ff6")}) node_id = 1 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59432024-11-22T04:06:24.223ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59442024-11-22T04:06:24.223ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59452024-11-22T04:06:24.226ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59462024-11-22T04:06:24.226ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59472024-11-22T04:06:24.230ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59482024-11-22T04:06:24.230ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59492024-11-22T04:06:24.232ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1017 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59502024-11-22T04:06:24.235ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537
59512024-11-22T04:06:24.235ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UpdateNetworkConfig
59522024-11-22T04:06:24.235ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UpdateNetworkConfig
59532024-11-22T04:06:24.238ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UpdateNetworkConfig
59542024-11-22T04:06:24.238ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UpdateNetworkConfig
59552024-11-22T04:06:24.243ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
59562024-11-22T04:06:24.243ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UpdateNetworkConfig
59572024-11-22T04:06:24.243ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UpdateNetworkConfig
59582024-11-22T04:06:24.245ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
59592024-11-22T04:06:24.245ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
59602024-11-22T04:06:24.245ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
59612024-11-22T04:06:24.247ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
59622024-11-22T04:06:24.248ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
59632024-11-22T04:06:24.248ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
59642024-11-22T04:06:24.248ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
59652024-11-22T04:06:24.251ZDEBGnexus: notifying dendrite of updates instance_id = Some(8c0a5ce4-0955-48e1-a1f1-3b7acf045537 (instance)) switch = switch0
59662024-11-22T04:06:24.252ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1613, tv_nsec: 603312242 } })
59672024-11-22T04:06:24.252ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
59682024-11-22T04:06:24.282ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59692024-11-22T04:06:24.282ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59702024-11-22T04:06:24.283ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d734a05-aca1-49bc-bf68-694aa22f5c85", "content-length": "26", "date": "Fri, 22 Nov 2024 04:06:24 GMT"} })
59712024-11-22T04:06:24.283ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59722024-11-22T04:06:24.284ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59732024-11-22T04:06:24.313ZDEBGnexus (DpdClient): client request body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
59742024-11-22T04:06:24.313ZDEBGnexus (DpdClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d6b0f35-bb19-44de-a367-c2e6f58ae275", "content-length": "4", "date": "Fri, 22 Nov 2024 04:06:24 GMT"} })
59752024-11-22T04:06:24.315ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59762024-11-22T04:06:24.315ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59772024-11-22T04:06:24.319ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59782024-11-22T04:06:24.319ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59792024-11-22T04:06:24.323ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
59802024-11-22T04:06:24.323ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
59812024-11-22T04:06:24.372ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1092 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2024-11-22T04:06:24.330963Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 3ac1be93-6287-4d44-9a76-4ff624883fe3, time_modified: Some(2024-11-22T04:06:24.330963Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, time_modified: Some(2024-11-22T04:06:24.330963Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59822024-11-22T04:06:24.372ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59832024-11-22T04:06:24.372ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59842024-11-22T04:06:24.376ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59852024-11-22T04:06:24.376ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59862024-11-22T04:06:24.380ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1127 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59872024-11-22T04:06:24.380ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UnassignOximeterProducer
59882024-11-22T04:06:24.380ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UnassignOximeterProducer
59892024-11-22T04:06:24.385ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 619dee3a-9d47-45ec-a665-d347c721dbd7 producer_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59902024-11-22T04:06:24.385ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UnassignOximeterProducer
59912024-11-22T04:06:24.385ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = UnassignOximeterProducer
59922024-11-22T04:06:24.422ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59932024-11-22T04:06:24.427ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/8c0a5ce4-0955-48e1-a1f1-3b7acf045537
59942024-11-22T04:06:24.446ZDEBGnexus (SagaExecutor): client response oximeter-collector = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/8c0a5ce4-0955-48e1-a1f1-3b7acf045537", status: 204, headers: {"x-request-id": "b604ed66-6ff5-46fe-b0aa-222d6462a875", "date": "Fri, 22 Nov 2024 04:06:24 GMT"} }) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59952024-11-22T04:06:24.446ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 619dee3a-9d47-45ec-a665-d347c721dbd7 producer_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
59962024-11-22T04:06:24.448ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59972024-11-22T04:06:24.448ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
59982024-11-22T04:06:24.452ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
59992024-11-22T04:06:24.452ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60002024-11-22T04:06:24.458ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 lock = UpdaterLock { updater_id: f2136669-a8f8-4242-9dc6-8dbcaac38ff6, locked_gen: Generation(Generation(3)) } new_runtime = InstanceRuntimeState { time_updated: 2024-11-22T04:06:24.151571073Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
60012024-11-22T04:06:24.458ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = CommitInstanceUpdates
60022024-11-22T04:06:24.458ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = CommitInstanceUpdates
60032024-11-22T04:06:24.495ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1176 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 new_runtime = InstanceRuntimeState { time_updated: 2024-11-22T04:06:24.151571073Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
60042024-11-22T04:06:24.495ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60052024-11-22T04:06:24.495ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60062024-11-22T04:06:24.495ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
60072024-11-22T04:06:24.495ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
60082024-11-22T04:06:24.495ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60092024-11-22T04:06:24.495ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
60102024-11-22T04:06:24.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60112024-11-22T04:06:24.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60122024-11-22T04:06:24.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60132024-11-22T04:06:24.498ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60142024-11-22T04:06:24.499ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60152024-11-22T04:06:24.499ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60162024-11-22T04:06:24.499ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60172024-11-22T04:06:24.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60182024-11-22T04:06:24.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60192024-11-22T04:06:24.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60202024-11-22T04:06:24.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
60212024-11-22T04:06:24.503ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60222024-11-22T04:06:24.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60232024-11-22T04:06:24.503ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60242024-11-22T04:06:24.503ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("8c0a5ce4-0955-48e1-a1f1-3b7acf045537"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ac35c2a3-f0ae-4a40-8af0-513950af66a1")}) node_id = 7 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60252024-11-22T04:06:24.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60262024-11-22T04:06:24.507ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60272024-11-22T04:06:24.507ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60282024-11-22T04:06:24.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60292024-11-22T04:06:24.511ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60302024-11-22T04:06:24.511ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60312024-11-22T04:06:24.514ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60322024-11-22T04:06:24.514ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60332024-11-22T04:06:24.517ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:83 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
60342024-11-22T04:06:24.517ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ReleaseSledResources
60352024-11-22T04:06:24.517ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ReleaseSledResources
60362024-11-22T04:06:24.522ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60372024-11-22T04:06:24.522ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60382024-11-22T04:06:24.526ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60392024-11-22T04:06:24.526ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60402024-11-22T04:06:24.530ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:114 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 propolis_id = ac35c2a3-f0ae-4a40-8af0-513950af66a1 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
60412024-11-22T04:06:24.530ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = MarkVmmDeleted
60422024-11-22T04:06:24.530ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = MarkVmmDeleted
60432024-11-22T04:06:24.538ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60442024-11-22T04:06:24.538ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60452024-11-22T04:06:24.542ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60462024-11-22T04:06:24.542ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60472024-11-22T04:06:24.545ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60482024-11-22T04:06:24.545ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60492024-11-22T04:06:24.549ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60502024-11-22T04:06:24.549ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60512024-11-22T04:06:24.552ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60522024-11-22T04:06:24.552ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60532024-11-22T04:06:24.554ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60542024-11-22T04:06:24.554ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60552024-11-22T04:06:24.555ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60562024-11-22T04:06:24.555ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60572024-11-22T04:06:24.556ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60582024-11-22T04:06:24.560ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, lookup_type: ById(f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208) }, key: 3ac1be93-6287-4d44-9a76-4ff624883fe3, lookup_type: ById(3ac1be93-6287-4d44-9a76-4ff624883fe3) }, key: 8c0a5ce4-0955-48e1-a1f1-3b7acf045537, lookup_type: ById(8c0a5ce4-0955-48e1-a1f1-3b7acf045537) } result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60592024-11-22T04:06:24.560ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60602024-11-22T04:06:24.560ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_node = ChainSuccessorSaga
60612024-11-22T04:06:24.565ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 karmic_state = WillReincarnate needs_reincarnation = false saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update
60622024-11-22T04:06:24.565ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60632024-11-22T04:06:24.565ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60642024-11-22T04:06:24.569ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60652024-11-22T04:06:24.569ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60662024-11-22T04:06:24.571ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60672024-11-22T04:06:24.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60682024-11-22T04:06:24.572ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60692024-11-22T04:06:24.572ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60702024-11-22T04:06:24.590ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60712024-11-22T04:06:24.590ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60722024-11-22T04:06:24.591ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "216794cf-d33d-4b50-b8c4-92711258efd0", "content-length": "372", "date": "Fri, 22 Nov 2024 04:06:24 GMT"} })
60732024-11-22T04:06:24.591ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60742024-11-22T04:06:24.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60752024-11-22T04:06:24.592ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60762024-11-22T04:06:24.593ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60772024-11-22T04:06:24.593ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60782024-11-22T04:06:24.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60792024-11-22T04:06:24.595ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60802024-11-22T04:06:24.595ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b955451a-cf62-4e30-90de-e9278739bfb6
60812024-11-22T04:06:24.595ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60822024-11-22T04:06:24.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f101b9d5-f8ad-4594-a836-795868313f95 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
60832024-11-22T04:06:24.599ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60842024-11-22T04:06:24.600ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60852024-11-22T04:06:24.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60862024-11-22T04:06:24.600ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f101b9d5-f8ad-4594-a836-795868313f95 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
60872024-11-22T04:06:24.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2497 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f101b9d5-f8ad-4594-a836-795868313f95 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
60882024-11-22T04:06:24.616ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60892024-11-22T04:06:24.616ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 saga_name = instance-update saga_result = SagaResult { saga_id: b955451a-cf62-4e30-90de-e9278739bfb6, saga_log: SagaLog { saga_id: b955451a-cf62-4e30-90de-e9278739bfb6, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("f2136669-a8f8-4242-9dc6-8dbcaac38ff6")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("f2136669-a8f8-4242-9dc6-8dbcaac38ff6")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("8c0a5ce4-0955-48e1-a1f1-3b7acf045537"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ac35c2a3-f0ae-4a40-8af0-513950af66a1")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("8c0a5ce4-0955-48e1-a1f1-3b7acf045537"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("ac35c2a3-f0ae-4a40-8af0-513950af66a1")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("f2136669-a8f8-4242-9dc6-8dbcaac38ff6"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("f2136669-a8f8-4242-9dc6-8dbcaac38ff6")}} }) }
60902024-11-22T04:06:24.616ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = b955451a-cf62-4e30-90de-e9278739bfb6 instance_id = 8c0a5ce4-0955-48e1-a1f1-3b7acf045537 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update
60912024-11-22T04:06:24.616ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60922024-11-22T04:06:24.616ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
60932024-11-22T04:06:24.620ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60942024-11-22T04:06:24.620ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
60952024-11-22T04:06:24.624ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60962024-11-22T04:06:24.624ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
60972024-11-22T04:06:24.626ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
60982024-11-22T04:06:24.626ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6
60992024-11-22T04:06:24.633ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
61002024-11-22T04:06:24.634ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a47e957e-1b9f-4705-9b59-934b652f5f03", "content-length": "691", "date": "Fri, 22 Nov 2024 04:06:24 GMT"} })
61012024-11-22T04:06:24.634ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
61022024-11-22T04:06:24.634ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
61032024-11-22T04:06:24.634ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
61042024-11-22T04:06:24.635ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 139.931693ms iteration = 24 status = {}
61052024-11-22T04:06:24.637ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
61062024-11-22T04:06:24.637ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
61072024-11-22T04:06:24.638ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bce04b1d-dda4-4363-b9b9-d6e3ca4b6a38", "date": "Fri, 22 Nov 2024 04:06:24 GMT"} })
61082024-11-22T04:06:24.638ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61092024-11-22T04:06:24.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61102024-11-22T04:06:24.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61112024-11-22T04:06:24.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61122024-11-22T04:06:24.643ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61132024-11-22T04:06:24.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61142024-11-22T04:06:24.646ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
61152024-11-22T04:06:24.646ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
61162024-11-22T04:06:24.646ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "328247fb-c05e-4221-af96-2801a65e7e19", "date": "Fri, 22 Nov 2024 04:06:24 GMT"} })
61172024-11-22T04:06:24.648ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 152.338793ms iteration = 24 status = {}
61182024-11-22T04:06:24.675ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update sec_id = 8af2b85f-6ab3-4781-9033-075825f48255
61192024-11-22T04:06:24.675ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = de15c569-e654-47bc-9e81-a9bd4a3e18c6 saga_name = start-instance-update saga_result = SagaResult { saga_id: de15c569-e654-47bc-9e81-a9bd4a3e18c6, saga_log: SagaLog { saga_id: de15c569-e654-47bc-9e81-a9bd4a3e18c6, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("783dee84-54fe-4b5e-abe5-3c7b44449e51")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("783dee84-54fe-4b5e-abe5-3c7b44449e51")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("783dee84-54fe-4b5e-abe5-3c7b44449e51"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("783dee84-54fe-4b5e-abe5-3c7b44449e51")}} }) }
61202024-11-22T04:06:25.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a96e0d28-7dd2-49ba-b66b-5f0bc964d144 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61212024-11-22T04:06:25.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a96e0d28-7dd2-49ba-b66b-5f0bc964d144 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61222024-11-22T04:06:25.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a96e0d28-7dd2-49ba-b66b-5f0bc964d144 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61232024-11-22T04:06:25.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 5cd4c09f-6350-48e5-b67b-7e56b7e27c54 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
61242024-11-22T04:06:25.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 5cd4c09f-6350-48e5-b67b-7e56b7e27c54 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
61252024-11-22T04:06:25.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 5cd4c09f-6350-48e5-b67b-7e56b7e27c54 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
61262024-11-22T04:06:26.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e79e704-578d-414f-ae0d-2b03e1a13e4a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61272024-11-22T04:06:26.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e79e704-578d-414f-ae0d-2b03e1a13e4a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61282024-11-22T04:06:26.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9e79e704-578d-414f-ae0d-2b03e1a13e4a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61292024-11-22T04:06:27.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 146b0456-3e13-4f12-ba46-c78f64210743 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61302024-11-22T04:06:27.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 146b0456-3e13-4f12-ba46-c78f64210743 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61312024-11-22T04:06:27.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 146b0456-3e13-4f12-ba46-c78f64210743 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61322024-11-22T04:06:28.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1a26aad2-ed25-4ca7-851d-9e3fd0a8ab18 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61332024-11-22T04:06:28.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1a26aad2-ed25-4ca7-851d-9e3fd0a8ab18 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61342024-11-22T04:06:28.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1a26aad2-ed25-4ca7-851d-9e3fd0a8ab18 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
61352024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
61362024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61372024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
61382024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
61392024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61402024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61412024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
61422024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
61432024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61442024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61452024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
61462024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61472024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
61482024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61492024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
61502024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61512024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
61522024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
61532024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61542024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61552024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
61562024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61572024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
61582024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61592024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
61602024-11-22T04:06:28.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61612024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61622024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
61632024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
61642024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61652024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
61662024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61672024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61682024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
61692024-11-22T04:06:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61702024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61712024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61722024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61732024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61742024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61752024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61762024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61772024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61782024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61792024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61802024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61812024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61822024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61832024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61842024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61852024-11-22T04:06:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61862024-11-22T04:06:28.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61872024-11-22T04:06:28.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1617, tv_nsec: 793265559 } })
61882024-11-22T04:06:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61892024-11-22T04:06:28.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.769367ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
61902024-11-22T04:06:28.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
61912024-11-22T04:06:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
61922024-11-22T04:06:28.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61932024-11-22T04:06:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61942024-11-22T04:06:28.445ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1617, tv_nsec: 796977184 } })
61952024-11-22T04:06:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61962024-11-22T04:06:28.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61972024-11-22T04:06:28.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
61982024-11-22T04:06:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61992024-11-22T04:06:28.447ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62002024-11-22T04:06:28.447ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62012024-11-22T04:06:28.447ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62022024-11-22T04:06:28.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62032024-11-22T04:06:28.452ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1617, tv_nsec: 803904187 } })
62042024-11-22T04:06:28.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62052024-11-22T04:06:28.453ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
62062024-11-22T04:06:28.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62072024-11-22T04:06:28.454ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62082024-11-22T04:06:28.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62092024-11-22T04:06:28.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62102024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62112024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62122024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62132024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62142024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62152024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62162024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62172024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62182024-11-22T04:06:28.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62192024-11-22T04:06:28.461ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62202024-11-22T04:06:28.461ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62212024-11-22T04:06:28.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62222024-11-22T04:06:28.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62232024-11-22T04:06:28.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62242024-11-22T04:06:28.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62252024-11-22T04:06:28.465ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62262024-11-22T04:06:28.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62272024-11-22T04:06:28.477ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62282024-11-22T04:06:28.480ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62292024-11-22T04:06:28.480ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62302024-11-22T04:06:28.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62312024-11-22T04:06:28.481ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62322024-11-22T04:06:28.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62332024-11-22T04:06:28.481ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 43.098185ms iteration = 24 status = {"errors":[],"records_set_to_done":[]}
62342024-11-22T04:06:28.482ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62352024-11-22T04:06:28.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62362024-11-22T04:06:28.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62372024-11-22T04:06:28.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62382024-11-22T04:06:28.485ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62392024-11-22T04:06:28.485ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.926973ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62402024-11-22T04:06:28.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62412024-11-22T04:06:28.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62422024-11-22T04:06:28.488ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62432024-11-22T04:06:28.488ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62442024-11-22T04:06:28.488ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62452024-11-22T04:06:28.488ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62462024-11-22T04:06:28.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62472024-11-22T04:06:28.490ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62482024-11-22T04:06:28.491ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.355527ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
62492024-11-22T04:06:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
62502024-11-22T04:06:28.492ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62512024-11-22T04:06:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62522024-11-22T04:06:28.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
62532024-11-22T04:06:28.493ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62542024-11-22T04:06:28.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62552024-11-22T04:06:28.494ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 55.78332ms iteration = 24 status = 0
62562024-11-22T04:06:28.499ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62572024-11-22T04:06:28.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62582024-11-22T04:06:28.502ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62592024-11-22T04:06:28.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62602024-11-22T04:06:28.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62612024-11-22T04:06:28.504ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62622024-11-22T04:06:28.504ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62632024-11-22T04:06:28.504ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62642024-11-22T04:06:28.505ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.786305ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62652024-11-22T04:06:28.512ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
62662024-11-22T04:06:28.512ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.488454ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
62672024-11-22T04:06:28.527ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62682024-11-22T04:06:28.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62692024-11-22T04:06:28.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.353741ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
62702024-11-22T04:06:28.530ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 91.767178ms iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
62712024-11-22T04:06:28.531ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62722024-11-22T04:06:28.531ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
62732024-11-22T04:06:28.531ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.356688ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
62742024-11-22T04:06:28.534ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.692778ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62752024-11-22T04:06:28.537ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62762024-11-22T04:06:28.537ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62772024-11-22T04:06:28.537ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "783958d7-77b9-4f10-82b4-1897224bc46e", "content-length": "26", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
62782024-11-22T04:06:28.537ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62792024-11-22T04:06:28.539ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62802024-11-22T04:06:28.557ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
62812024-11-22T04:06:28.557ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62822024-11-22T04:06:28.557ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47be2b1c-9cf0-4df0-a294-aa652ffdf6b7", "content-length": "26", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
62832024-11-22T04:06:28.557ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62842024-11-22T04:06:28.559ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
62852024-11-22T04:06:28.563ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62862024-11-22T04:06:28.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62872024-11-22T04:06:28.568ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62882024-11-22T04:06:28.568ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62892024-11-22T04:06:28.568ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4204a33-7bae-4652-83cd-0c1e2d39b28e", "content-length": "26", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
62902024-11-22T04:06:28.568ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62912024-11-22T04:06:28.570ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62922024-11-22T04:06:28.595ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 156.946915ms iteration = 27 status = {"physical_disks_added":0}
62932024-11-22T04:06:28.607ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62942024-11-22T04:06:28.607ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62952024-11-22T04:06:28.607ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f93c9294-0694-433a-ae45-89b24bba5b28", "content-length": "372", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
62962024-11-22T04:06:28.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62972024-11-22T04:06:28.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62982024-11-22T04:06:28.639ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62992024-11-22T04:06:28.639ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d255e7a7-406e-43b0-aeb8-d666efb97c0e", "content-length": "2", "date": "Fri, 22 Nov 2024 04:06:27 GMT"} })
63002024-11-22T04:06:28.640ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63012024-11-22T04:06:28.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63022024-11-22T04:06:28.643ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 205.195341ms iteration = 24 status = null
63032024-11-22T04:06:28.657ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 218.468696ms iteration = 24 status = {}
63042024-11-22T04:06:28.660ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63052024-11-22T04:06:28.660ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63062024-11-22T04:06:28.662ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63072024-11-22T04:06:28.664ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63082024-11-22T04:06:28.664ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63092024-11-22T04:06:28.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63102024-11-22T04:06:28.665ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
63112024-11-22T04:06:28.665ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63122024-11-22T04:06:28.667ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63132024-11-22T04:06:28.669ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63142024-11-22T04:06:28.669ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63152024-11-22T04:06:28.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63162024-11-22T04:06:28.719ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63172024-11-22T04:06:28.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63182024-11-22T04:06:28.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63192024-11-22T04:06:28.736ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
63202024-11-22T04:06:28.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63212024-11-22T04:06:28.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63222024-11-22T04:06:28.747ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63232024-11-22T04:06:28.748ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f414d3-2837-4863-988f-8e6bf307b3da", "content-length": "134", "date": "Fri, 22 Nov 2024 04:06:27 GMT"} })
63242024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63252024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
63262024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63272024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63282024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63292024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63302024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63312024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63322024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63332024-11-22T04:06:28.748ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63342024-11-22T04:06:28.748ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "de1c9b00-2d40-49c5-9305-6263d6fbdb8b", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
63352024-11-22T04:06:28.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63362024-11-22T04:06:28.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63372024-11-22T04:06:28.749ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
63382024-11-22T04:06:28.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63392024-11-22T04:06:28.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63402024-11-22T04:06:28.749ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "90275fef-a62d-4d7e-8fe4-6b2845547886", "content-length": "691", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
63412024-11-22T04:06:28.749ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63422024-11-22T04:06:28.749ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63432024-11-22T04:06:28.749ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63442024-11-22T04:06:28.750ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 311.798782ms iteration = 25 status = {}
63452024-11-22T04:06:28.751ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63462024-11-22T04:06:28.751ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "adb4e01e-c83e-44aa-a0cd-b957d9e1a22f", "content-length": "2", "date": "Fri, 22 Nov 2024 04:06:27 GMT"} })
63472024-11-22T04:06:28.751ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63482024-11-22T04:06:28.751ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d34f7ddc-7248-4faf-a8e5-870c03939b12", "content-length": "52", "date": "Fri, 22 Nov 2024 04:06:27 GMT"} })
63492024-11-22T04:06:28.751ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
63502024-11-22T04:06:28.751ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63512024-11-22T04:06:28.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63522024-11-22T04:06:28.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63532024-11-22T04:06:28.755ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63542024-11-22T04:06:28.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63552024-11-22T04:06:28.758ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63562024-11-22T04:06:28.758ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63572024-11-22T04:06:28.848ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0a0992e8-119e-4915-89d7-f640c2f250eb", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
63582024-11-22T04:06:28.848ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
63592024-11-22T04:06:28.848ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63602024-11-22T04:06:28.848ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a650fbc1-6b54-40e8-8104-0715b7a4f9e6", "content-length": "682", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
63612024-11-22T04:06:28.848ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63622024-11-22T04:06:28.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63632024-11-22T04:06:28.848ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "59205349-d701-4e2f-bd36-32f871ce26c3", "date": "Fri, 22 Nov 2024 04:06:28 GMT"} })
63642024-11-22T04:06:28.850ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 411.683794ms iteration = 25 status = {}
63652024-11-22T04:06:28.852ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63662024-11-22T04:06:28.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63672024-11-22T04:06:28.856ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63682024-11-22T04:06:28.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63692024-11-22T04:06:28.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63702024-11-22T04:06:28.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63712024-11-22T04:06:28.865ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 427.294921ms iteration = 24 status = {}
63722024-11-22T04:06:29.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 758a576c-e0d7-42fc-b2df-5f8b0f2e8a8e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63732024-11-22T04:06:29.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 758a576c-e0d7-42fc-b2df-5f8b0f2e8a8e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63742024-11-22T04:06:29.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2403 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 758a576c-e0d7-42fc-b2df-5f8b0f2e8a8e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63752024-11-22T04:06:30.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ae9bed1-d7f7-465b-a3dc-c3fd1539d161 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63762024-11-22T04:06:30.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ae9bed1-d7f7-465b-a3dc-c3fd1539d161 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63772024-11-22T04:06:30.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2054 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ae9bed1-d7f7-465b-a3dc-c3fd1539d161 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63782024-11-22T04:06:30.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 591 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = e28c32a0-37e9-43d1-ae29-516d42d1f0e5 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
63792024-11-22T04:06:31.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86334f13-d3fc-422c-8a70-78fdcb1b9b84 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63802024-11-22T04:06:31.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86334f13-d3fc-422c-8a70-78fdcb1b9b84 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63812024-11-22T04:06:31.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2032 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86334f13-d3fc-422c-8a70-78fdcb1b9b84 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63822024-11-22T04:06:32.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43dbc2b9-f2c6-408d-92e7-df5e8223bf9f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63832024-11-22T04:06:32.278ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43dbc2b9-f2c6-408d-92e7-df5e8223bf9f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63842024-11-22T04:06:32.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2282 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 43dbc2b9-f2c6-408d-92e7-df5e8223bf9f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63852024-11-22T04:06:33.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be20178a-b321-4241-8f69-cf3d1906a913 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63862024-11-22T04:06:33.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be20178a-b321-4241-8f69-cf3d1906a913 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63872024-11-22T04:06:33.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be20178a-b321-4241-8f69-cf3d1906a913 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63882024-11-22T04:06:34.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 90c8ab07-5497-44f4-b1c3-83d117b8d304 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63892024-11-22T04:06:34.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 90c8ab07-5497-44f4-b1c3-83d117b8d304 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63902024-11-22T04:06:34.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2401 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 90c8ab07-5497-44f4-b1c3-83d117b8d304 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63912024-11-22T04:06:35.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 825d455d-9b2d-4772-9882-f3d9309f8cb8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63922024-11-22T04:06:35.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 825d455d-9b2d-4772-9882-f3d9309f8cb8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63932024-11-22T04:06:35.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 825d455d-9b2d-4772-9882-f3d9309f8cb8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63942024-11-22T04:06:36.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4e6d6c89-d1a0-43d0-9507-e0b7ffec4bc5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63952024-11-22T04:06:36.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4e6d6c89-d1a0-43d0-9507-e0b7ffec4bc5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63962024-11-22T04:06:36.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1858 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4e6d6c89-d1a0-43d0-9507-e0b7ffec4bc5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63972024-11-22T04:06:37.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b9a286f9-2bfe-486a-b2aa-b4248d8e09f6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63982024-11-22T04:06:37.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b9a286f9-2bfe-486a-b2aa-b4248d8e09f6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
63992024-11-22T04:06:37.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b9a286f9-2bfe-486a-b2aa-b4248d8e09f6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64002024-11-22T04:06:38.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 144a3bbf-d798-490d-91b7-ef749b2689a3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64012024-11-22T04:06:38.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 144a3bbf-d798-490d-91b7-ef749b2689a3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64022024-11-22T04:06:38.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2505 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 144a3bbf-d798-490d-91b7-ef749b2689a3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64032024-11-22T04:06:38.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
64042024-11-22T04:06:38.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
64052024-11-22T04:06:38.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64062024-11-22T04:06:38.437ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64072024-11-22T04:06:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64082024-11-22T04:06:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64092024-11-22T04:06:38.439ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64102024-11-22T04:06:38.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64112024-11-22T04:06:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64122024-11-22T04:06:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64132024-11-22T04:06:38.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64142024-11-22T04:06:38.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64152024-11-22T04:06:38.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64162024-11-22T04:06:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64172024-11-22T04:06:38.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64182024-11-22T04:06:38.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
64192024-11-22T04:06:38.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64202024-11-22T04:06:38.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64212024-11-22T04:06:38.456ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
64222024-11-22T04:06:38.456ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.680111ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
64232024-11-22T04:06:38.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.567438ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64242024-11-22T04:06:39.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6b01231-320a-4838-86f9-70713c7a652d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64252024-11-22T04:06:39.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6b01231-320a-4838-86f9-70713c7a652d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64262024-11-22T04:06:39.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2422 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6b01231-320a-4838-86f9-70713c7a652d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64272024-11-22T04:06:40.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 054e239b-05a1-44f1-b735-40563782c6a4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64282024-11-22T04:06:40.444ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 054e239b-05a1-44f1-b735-40563782c6a4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64292024-11-22T04:06:40.445ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1946 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 054e239b-05a1-44f1-b735-40563782c6a4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64302024-11-22T04:06:40.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 511 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 71605c2b-4b60-4048-92b9-9d83a8445f6d response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
64312024-11-22T04:06:41.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3ef7737-c88d-49d8-ad50-5e13a0387a9e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64322024-11-22T04:06:41.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3ef7737-c88d-49d8-ad50-5e13a0387a9e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64332024-11-22T04:06:41.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e3ef7737-c88d-49d8-ad50-5e13a0387a9e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64342024-11-22T04:06:42.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b5b98b24-2d63-4b66-b170-9e6dbed34dd3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64352024-11-22T04:06:42.487ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b5b98b24-2d63-4b66-b170-9e6dbed34dd3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64362024-11-22T04:06:42.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2736 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b5b98b24-2d63-4b66-b170-9e6dbed34dd3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64372024-11-22T04:06:43.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db3fb77e-e59a-43e3-816c-b5cd511c3018 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64382024-11-22T04:06:43.509ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db3fb77e-e59a-43e3-816c-b5cd511c3018 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64392024-11-22T04:06:43.510ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2116 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db3fb77e-e59a-43e3-816c-b5cd511c3018 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64402024-11-22T04:06:44.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a743f8c4-aefa-4821-ab68-63db61037b3e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64412024-11-22T04:06:44.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a743f8c4-aefa-4821-ab68-63db61037b3e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64422024-11-22T04:06:44.532ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2354 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a743f8c4-aefa-4821-ab68-63db61037b3e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64432024-11-22T04:06:45.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4d9bc0a0-fdf7-44f0-8b43-6f13e62b7770 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64442024-11-22T04:06:45.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4d9bc0a0-fdf7-44f0-8b43-6f13e62b7770 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64452024-11-22T04:06:45.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2112 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4d9bc0a0-fdf7-44f0-8b43-6f13e62b7770 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64462024-11-22T04:06:46.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d21e396-9fa3-41b1-ae2e-48f60c5b517a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64472024-11-22T04:06:46.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d21e396-9fa3-41b1-ae2e-48f60c5b517a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64482024-11-22T04:06:46.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8d21e396-9fa3-41b1-ae2e-48f60c5b517a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64492024-11-22T04:06:47.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be886970-94ac-4260-8717-aa550c8a4989 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64502024-11-22T04:06:47.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be886970-94ac-4260-8717-aa550c8a4989 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64512024-11-22T04:06:47.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = be886970-94ac-4260-8717-aa550c8a4989 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64522024-11-22T04:06:48.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
64532024-11-22T04:06:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64542024-11-22T04:06:48.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
64552024-11-22T04:06:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64562024-11-22T04:06:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64572024-11-22T04:06:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64582024-11-22T04:06:48.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64592024-11-22T04:06:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64602024-11-22T04:06:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64612024-11-22T04:06:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64622024-11-22T04:06:48.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64632024-11-22T04:06:48.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64642024-11-22T04:06:48.448ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64652024-11-22T04:06:48.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
64662024-11-22T04:06:48.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64672024-11-22T04:06:48.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64682024-11-22T04:06:48.464ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
64692024-11-22T04:06:48.464ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.817648ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
64702024-11-22T04:06:48.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64712024-11-22T04:06:48.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64722024-11-22T04:06:48.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.888073ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64732024-11-22T04:06:48.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ffd8bae-d6ac-4081-b666-00cf8bb501d8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64742024-11-22T04:06:48.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ffd8bae-d6ac-4081-b666-00cf8bb501d8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64752024-11-22T04:06:48.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2150 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ffd8bae-d6ac-4081-b666-00cf8bb501d8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64762024-11-22T04:06:49.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c0f421bf-2e3e-4d50-be24-c26b32cd4da9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64772024-11-22T04:06:49.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c0f421bf-2e3e-4d50-be24-c26b32cd4da9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64782024-11-22T04:06:49.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1906 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c0f421bf-2e3e-4d50-be24-c26b32cd4da9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64792024-11-22T04:06:50.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 932 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 8d49e3fe-ca8c-4101-99b5-db07fcbd6964 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
64802024-11-22T04:06:50.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a65615be-50df-4e6e-a89d-1afa6d311adf roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64812024-11-22T04:06:50.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a65615be-50df-4e6e-a89d-1afa6d311adf resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64822024-11-22T04:06:50.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2372 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a65615be-50df-4e6e-a89d-1afa6d311adf response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64832024-11-22T04:06:51.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c8b63de-a1c9-4672-ac22-482bdbdcdce2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64842024-11-22T04:06:51.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c8b63de-a1c9-4672-ac22-482bdbdcdce2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64852024-11-22T04:06:51.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2518 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c8b63de-a1c9-4672-ac22-482bdbdcdce2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64862024-11-22T04:06:52.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c953affc-3b7a-4a57-a3c0-274d8ee79cea roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64872024-11-22T04:06:52.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c953affc-3b7a-4a57-a3c0-274d8ee79cea resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64882024-11-22T04:06:52.701ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2371 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c953affc-3b7a-4a57-a3c0-274d8ee79cea response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64892024-11-22T04:06:53.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9a171db-9af7-4181-8228-deca2530ddd4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64902024-11-22T04:06:53.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9a171db-9af7-4181-8228-deca2530ddd4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64912024-11-22T04:06:53.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9a171db-9af7-4181-8228-deca2530ddd4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64922024-11-22T04:06:54.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 564e298b-6815-4d42-94a9-4cda5da640f9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64932024-11-22T04:06:54.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 564e298b-6815-4d42-94a9-4cda5da640f9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64942024-11-22T04:06:54.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1940 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 564e298b-6815-4d42-94a9-4cda5da640f9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
64952024-11-22T04:06:55.626ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:43994
64962024-11-22T04:06:55.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = ed8a2ebf-567d-4d48-abab-7ce6a96e3a0b roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
64972024-11-22T04:06:55.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = ed8a2ebf-567d-4d48-abab-7ce6a96e3a0b resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
64982024-11-22T04:06:55.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2700 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = ed8a2ebf-567d-4d48-abab-7ce6a96e3a0b response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
64992024-11-22T04:06:55.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = a2063a97-9e11-430d-8555-2d9f7cd82361 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
65002024-11-22T04:06:55.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = a2063a97-9e11-430d-8555-2d9f7cd82361 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
65012024-11-22T04:06:55.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = a2063a97-9e11-430d-8555-2d9f7cd82361 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
65022024-11-22T04:06:55.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 409d6e65-bbab-4781-bba5-35b68fceaad9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
65032024-11-22T04:06:55.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 409d6e65-bbab-4781-bba5-35b68fceaad9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
65042024-11-22T04:06:55.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2355 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 409d6e65-bbab-4781-bba5-35b68fceaad9 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
65052024-11-22T04:06:55.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5bd64ee4-be53-41cb-9b84-052eadcbb8de roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65062024-11-22T04:06:55.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5bd64ee4-be53-41cb-9b84-052eadcbb8de resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65072024-11-22T04:06:55.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2373 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5bd64ee4-be53-41cb-9b84-052eadcbb8de response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65082024-11-22T04:06:56.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5eea156a-ea30-4295-aac1-26dfa7b42c49 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65092024-11-22T04:06:56.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5eea156a-ea30-4295-aac1-26dfa7b42c49 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65102024-11-22T04:06:56.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1617 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5eea156a-ea30-4295-aac1-26dfa7b42c49 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65112024-11-22T04:06:57.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e65ecbe-4481-4af4-b842-1a47e9866599 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65122024-11-22T04:06:57.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e65ecbe-4481-4af4-b842-1a47e9866599 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65132024-11-22T04:06:57.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2532 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6e65ecbe-4481-4af4-b842-1a47e9866599 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
65142024-11-22T04:06:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
65152024-11-22T04:06:58.436ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
65162024-11-22T04:06:58.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65172024-11-22T04:06:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
65182024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65192024-11-22T04:06:58.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 788531564 } })
65202024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
65212024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
65222024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65232024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65242024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
65252024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
65262024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65272024-11-22T04:06:58.437ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:56:58.437733836 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
65282024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
65292024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
65302024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65312024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
65322024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
65332024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
65342024-11-22T04:06:58.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
65352024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65362024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65372024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
65382024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.681\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
65392024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65402024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
65412024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
65422024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
65432024-11-22T04:06:58.437ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
65442024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65452024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
65462024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65472024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65482024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
65492024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
65502024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
65512024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65522024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
65532024-11-22T04:06:58.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
65542024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65552024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
65562024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65572024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
65582024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
65592024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
65602024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
65612024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65622024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65632024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
65642024-11-22T04:06:58.438ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
65652024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65662024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
65672024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65682024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
65692024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65702024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65712024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
65722024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65732024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
65742024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
65752024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65762024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
65772024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
65782024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
65792024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
65802024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65812024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65822024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65832024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65842024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
65852024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65862024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.417145ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
65872024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65882024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65892024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65902024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65912024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65922024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
65932024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65942024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
65952024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65962024-11-22T04:06:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 789569763 } })
65972024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65982024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65992024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66002024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66012024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
66022024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66032024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66042024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66052024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
66062024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
66072024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66082024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66092024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66102024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66112024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66122024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66132024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66142024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66152024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66162024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
66172024-11-22T04:06:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.206601ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
66182024-11-22T04:06:58.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66192024-11-22T04:06:58.440ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:56:58.437733836 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
66202024-11-22T04:06:58.440ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.136316ms iteration = 13 status = {"expiration":"2024-11-22T03:56:58.437733836Z","pruned":[]}
66212024-11-22T04:06:58.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 792564816 } })
66222024-11-22T04:06:58.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 792753619 } })
66232024-11-22T04:06:58.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
66242024-11-22T04:06:58.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
66252024-11-22T04:06:58.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.392538ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
66262024-11-22T04:06:58.442ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66272024-11-22T04:06:58.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66282024-11-22T04:06:58.444ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 6.524785ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
66292024-11-22T04:06:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66302024-11-22T04:06:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66312024-11-22T04:06:58.445ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66322024-11-22T04:06:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66332024-11-22T04:06:58.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66342024-11-22T04:06:58.447ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66352024-11-22T04:06:58.447ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66362024-11-22T04:06:58.447ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66372024-11-22T04:06:58.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66382024-11-22T04:06:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66392024-11-22T04:06:58.447ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66402024-11-22T04:06:58.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66412024-11-22T04:06:58.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66422024-11-22T04:06:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66432024-11-22T04:06:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
66442024-11-22T04:06:58.449ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
66452024-11-22T04:06:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
66462024-11-22T04:06:58.450ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66472024-11-22T04:06:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
66482024-11-22T04:06:58.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66492024-11-22T04:06:58.453ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66502024-11-22T04:06:58.453ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66512024-11-22T04:06:58.453ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.428043ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66522024-11-22T04:06:58.453ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.567517ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
66532024-11-22T04:06:58.454ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66542024-11-22T04:06:58.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66552024-11-22T04:06:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66562024-11-22T04:06:58.455ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66572024-11-22T04:06:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66582024-11-22T04:06:58.456ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66592024-11-22T04:06:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66602024-11-22T04:06:58.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66612024-11-22T04:06:58.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66622024-11-22T04:06:58.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66632024-11-22T04:06:58.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66642024-11-22T04:06:58.458ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66652024-11-22T04:06:58.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66662024-11-22T04:06:58.460ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66672024-11-22T04:06:58.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66682024-11-22T04:06:58.462ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66692024-11-22T04:06:58.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66702024-11-22T04:06:58.463ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66712024-11-22T04:06:58.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66722024-11-22T04:06:58.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66732024-11-22T04:06:58.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66742024-11-22T04:06:58.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
66752024-11-22T04:06:58.465ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
66762024-11-22T04:06:58.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
66772024-11-22T04:06:58.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66782024-11-22T04:06:58.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66792024-11-22T04:06:58.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66802024-11-22T04:06:58.469ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66812024-11-22T04:06:58.469ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66822024-11-22T04:06:58.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66832024-11-22T04:06:58.470ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66842024-11-22T04:06:58.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66852024-11-22T04:06:58.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66862024-11-22T04:06:58.474ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66872024-11-22T04:06:58.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66882024-11-22T04:06:58.477ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66892024-11-22T04:06:58.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66902024-11-22T04:06:58.478ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66912024-11-22T04:06:58.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66922024-11-22T04:06:58.484ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66932024-11-22T04:06:58.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66942024-11-22T04:06:58.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66952024-11-22T04:06:58.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66962024-11-22T04:06:58.487ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66972024-11-22T04:06:58.487ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66982024-11-22T04:06:58.488ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66992024-11-22T04:06:58.489ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67002024-11-22T04:06:58.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67012024-11-22T04:06:58.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67022024-11-22T04:06:58.490ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67032024-11-22T04:06:58.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67042024-11-22T04:06:58.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67052024-11-22T04:06:58.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67062024-11-22T04:06:58.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67072024-11-22T04:06:58.492ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67082024-11-22T04:06:58.492ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67092024-11-22T04:06:58.492ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67102024-11-22T04:06:58.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67112024-11-22T04:06:58.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67122024-11-22T04:06:58.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.129789ms iteration = 25 status = {"errors":[],"records_set_to_done":[]}
67132024-11-22T04:06:58.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67142024-11-22T04:06:58.494ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67152024-11-22T04:06:58.494ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67162024-11-22T04:06:58.494ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
67172024-11-22T04:06:58.494ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67182024-11-22T04:06:58.494ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 56.618855ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
67192024-11-22T04:06:58.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67202024-11-22T04:06:58.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67212024-11-22T04:06:58.495ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67222024-11-22T04:06:58.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67232024-11-22T04:06:58.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67242024-11-22T04:06:58.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67252024-11-22T04:06:58.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67262024-11-22T04:06:58.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 60.90038ms iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67272024-11-22T04:06:58.499ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67282024-11-22T04:06:58.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67292024-11-22T04:06:58.499ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67302024-11-22T04:06:58.499ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
67312024-11-22T04:06:58.499ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67322024-11-22T04:06:58.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67332024-11-22T04:06:58.500ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67342024-11-22T04:06:58.501ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67352024-11-22T04:06:58.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67362024-11-22T04:06:58.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67372024-11-22T04:06:58.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67382024-11-22T04:06:58.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67392024-11-22T04:06:58.502ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
67402024-11-22T04:06:58.502ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
67412024-11-22T04:06:58.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
67422024-11-22T04:06:58.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67432024-11-22T04:06:58.503ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
67442024-11-22T04:06:58.503ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 65.428221ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
67452024-11-22T04:06:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67462024-11-22T04:06:58.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67472024-11-22T04:06:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67482024-11-22T04:06:58.505ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.441897ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67492024-11-22T04:06:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
67502024-11-22T04:06:58.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67512024-11-22T04:06:58.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67522024-11-22T04:06:58.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67532024-11-22T04:06:58.508ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
67542024-11-22T04:06:58.508ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
67552024-11-22T04:06:58.508ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 70.156085ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
67562024-11-22T04:06:58.509ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67572024-11-22T04:06:58.509ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67582024-11-22T04:06:58.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67592024-11-22T04:06:58.514ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 77.078748ms iteration = 6 status = {"nsuccess":5}
67602024-11-22T04:06:58.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67612024-11-22T04:06:58.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67622024-11-22T04:06:58.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67632024-11-22T04:06:58.520ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1647, tv_nsec: 871378785 } })
67642024-11-22T04:06:58.520ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
67652024-11-22T04:06:58.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67662024-11-22T04:06:58.521ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67672024-11-22T04:06:58.521ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67682024-11-22T04:06:58.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67692024-11-22T04:06:58.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67702024-11-22T04:06:58.523ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67712024-11-22T04:06:58.523ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67722024-11-22T04:06:58.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67732024-11-22T04:06:58.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67742024-11-22T04:06:58.524ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67752024-11-22T04:06:58.527ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
67762024-11-22T04:06:58.527ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67772024-11-22T04:06:58.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67782024-11-22T04:06:58.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-11-22T04:06:58.529ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.220498ms iteration = 25 status = 0
67802024-11-22T04:06:58.530ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67812024-11-22T04:06:58.531ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
67822024-11-22T04:06:58.531ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
67832024-11-22T04:06:58.531ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67842024-11-22T04:06:58.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67852024-11-22T04:06:58.531ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
67862024-11-22T04:06:58.531ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
67872024-11-22T04:06:58.531ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 93.53634ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
67882024-11-22T04:06:58.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67892024-11-22T04:06:58.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67902024-11-22T04:06:58.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67912024-11-22T04:06:58.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67922024-11-22T04:06:58.534ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67932024-11-22T04:06:58.536ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67942024-11-22T04:06:58.536ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67952024-11-22T04:06:58.536ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
67962024-11-22T04:06:58.536ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 99.73215ms iteration = 13 status = {"generation":1}
67972024-11-22T04:06:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67982024-11-22T04:06:58.538ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67992024-11-22T04:06:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68002024-11-22T04:06:58.540ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68012024-11-22T04:06:58.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68022024-11-22T04:06:58.542ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68032024-11-22T04:06:58.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68042024-11-22T04:06:58.551ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 113.355331ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
68052024-11-22T04:06:58.551ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68062024-11-22T04:06:58.551ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68072024-11-22T04:06:58.551ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 113.764959ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68082024-11-22T04:06:58.558ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 120.237343ms iteration = 28 status = {"physical_disks_added":0}
68092024-11-22T04:06:58.586ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68102024-11-22T04:06:58.586ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
68112024-11-22T04:06:58.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68122024-11-22T04:06:58.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68132024-11-22T04:06:58.602ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) }
68142024-11-22T04:06:58.602ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 164.759004ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
68152024-11-22T04:06:58.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68162024-11-22T04:06:58.604ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
68172024-11-22T04:06:58.606ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68182024-11-22T04:06:58.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68192024-11-22T04:06:58.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68202024-11-22T04:06:58.609ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
68212024-11-22T04:06:58.609ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
68222024-11-22T04:06:58.609ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
68232024-11-22T04:06:58.609ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 171.055565ms iteration = 13 status = {"generation":2}
68242024-11-22T04:06:58.653ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
68252024-11-22T04:06:58.653ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 215.177568ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
68262024-11-22T04:06:58.659ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68272024-11-22T04:06:58.659ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68282024-11-22T04:06:58.659ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "612777e3-8926-4573-9340-ec92b1bb2e9e", "content-length": "26", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68292024-11-22T04:06:58.659ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68302024-11-22T04:06:58.666ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68312024-11-22T04:06:58.734ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68322024-11-22T04:06:58.735ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c5f1cf3-a503-4687-bb6e-95d1240e5453", "content-length": "691", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68332024-11-22T04:06:58.735ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
68342024-11-22T04:06:58.735ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68352024-11-22T04:06:58.735ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68362024-11-22T04:06:58.738ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 300.339759ms iteration = 26 status = {}
68372024-11-22T04:06:58.744ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
68382024-11-22T04:06:58.744ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68392024-11-22T04:06:58.745ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "53d6cedc-d899-4b97-b333-539b002cddd5", "content-length": "26", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68402024-11-22T04:06:58.745ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68412024-11-22T04:06:58.747ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
68422024-11-22T04:06:58.755ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
68432024-11-22T04:06:58.755ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68442024-11-22T04:06:58.756ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c56eb480-36aa-4523-bdbf-df4091e9b2cc", "content-length": "26", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68452024-11-22T04:06:58.756ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68462024-11-22T04:06:58.757ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68472024-11-22T04:06:58.764ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
68482024-11-22T04:06:58.823ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
68492024-11-22T04:06:58.823ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68502024-11-22T04:06:58.826ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
68512024-11-22T04:06:58.826ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "53a1c824-da4f-4453-9cfe-c86b36cfe79d", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68522024-11-22T04:06:58.826ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68532024-11-22T04:06:58.828ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "552cc0fb-b42c-4361-a3d2-eb5fdd74595d", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68542024-11-22T04:06:58.828ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68552024-11-22T04:06:58.830ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
68562024-11-22T04:06:58.830ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 392.470774ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
68572024-11-22T04:06:58.840ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 402.258407ms iteration = 25 status = {}
68582024-11-22T04:06:58.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ce74644-1830-4197-b492-b1f2fea7b97e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
68592024-11-22T04:06:58.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ce74644-1830-4197-b492-b1f2fea7b97e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
68602024-11-22T04:06:58.862ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "89de28c6-a6ee-4646-9940-39724e3d51bf", "content-length": "372", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68612024-11-22T04:06:58.862ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68622024-11-22T04:06:58.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68632024-11-22T04:06:58.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2955 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ce74644-1830-4197-b492-b1f2fea7b97e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
68642024-11-22T04:06:58.877ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
68652024-11-22T04:06:58.877ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
68662024-11-22T04:06:58.877ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "955a307b-d133-4046-a486-8c773679943a", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68672024-11-22T04:06:58.877ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68682024-11-22T04:06:58.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68692024-11-22T04:06:58.880ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68702024-11-22T04:06:58.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68712024-11-22T04:06:58.883ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68722024-11-22T04:06:58.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68732024-11-22T04:06:58.886ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68742024-11-22T04:06:58.886ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68752024-11-22T04:06:58.887ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1ba449eb-9e4f-4bce-9e1d-736bf2b8f1c0", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68762024-11-22T04:06:58.888ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 450.943452ms iteration = 26 status = {}
68772024-11-22T04:06:58.908ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
68782024-11-22T04:06:58.980ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
68792024-11-22T04:06:58.981ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "94279717-2131-4500-b3a1-a401d495f7c7", "content-length": "2", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68802024-11-22T04:06:58.983ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68812024-11-22T04:06:58.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
68822024-11-22T04:06:58.984ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 547.219799ms iteration = 25 status = null
68832024-11-22T04:06:59.001ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
68842024-11-22T04:06:59.001ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f44129e8-ca24-4ef7-b9f8-648aa53dbc62", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68852024-11-22T04:06:59.001ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68862024-11-22T04:06:59.002ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9e9cf9df-d590-49cb-9bf5-80c205fb1fc7", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68872024-11-22T04:06:59.002ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68882024-11-22T04:06:59.004ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "061bb596-3466-4b83-8df8-c4eb62ff591c", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68892024-11-22T04:06:59.004ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68902024-11-22T04:06:59.006ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
68912024-11-22T04:06:59.006ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 568.840693ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
68922024-11-22T04:06:59.057ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68932024-11-22T04:06:59.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68942024-11-22T04:06:59.060ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
68952024-11-22T04:06:59.060ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68962024-11-22T04:06:59.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68972024-11-22T04:06:59.071ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68982024-11-22T04:06:59.071ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc1f89f4-18c1-4672-acdd-d0bdc641050a", "content-length": "134", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
68992024-11-22T04:06:59.071ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69002024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
69012024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69022024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69032024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69042024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69052024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69062024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69072024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69082024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69092024-11-22T04:06:59.072ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
69102024-11-22T04:06:59.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69112024-11-22T04:06:59.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69122024-11-22T04:06:59.075ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69132024-11-22T04:06:59.075ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bc18253-6ba1-4d58-b6e0-f4c45b20790b", "content-length": "2", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
69142024-11-22T04:06:59.075ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69152024-11-22T04:06:59.075ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad1d2a20-7ed6-4830-a6a3-1185fdef954a", "content-length": "52", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
69162024-11-22T04:06:59.075ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
69172024-11-22T04:06:59.075ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69182024-11-22T04:06:59.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "506a207f-bcd4-4a22-993f-e8f5cab0e235", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
69192024-11-22T04:06:59.258ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
69202024-11-22T04:06:59.258ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69212024-11-22T04:06:59.258ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f552e09b-6b32-4f07-88ee-c4219c810625", "content-length": "682", "date": "Fri, 22 Nov 2024 04:06:58 GMT"} })
69222024-11-22T04:06:59.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69232024-11-22T04:06:59.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69242024-11-22T04:06:59.262ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69252024-11-22T04:06:59.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69262024-11-22T04:06:59.265ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69272024-11-22T04:06:59.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69282024-11-22T04:06:59.268ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69292024-11-22T04:06:59.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69302024-11-22T04:06:59.275ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 837.759745ms iteration = 25 status = {}
69312024-11-22T04:06:59.885ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cace5c3e-47a2-4828-82e8-ee6b9799237d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69322024-11-22T04:06:59.885ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cace5c3e-47a2-4828-82e8-ee6b9799237d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69332024-11-22T04:06:59.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2509 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cace5c3e-47a2-4828-82e8-ee6b9799237d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69342024-11-22T04:07:00.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 63d67fa8-93a5-490a-a3a5-a61ecae6a4d4 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
69352024-11-22T04:07:00.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c6019b32-6d3c-4728-bbcd-ceea724f0f09 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69362024-11-22T04:07:00.906ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c6019b32-6d3c-4728-bbcd-ceea724f0f09 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69372024-11-22T04:07:00.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2324 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c6019b32-6d3c-4728-bbcd-ceea724f0f09 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69382024-11-22T04:07:01.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cff9db41-8bd0-4e75-b2fb-1044c1e4e65b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69392024-11-22T04:07:01.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cff9db41-8bd0-4e75-b2fb-1044c1e4e65b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69402024-11-22T04:07:01.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2103 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cff9db41-8bd0-4e75-b2fb-1044c1e4e65b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69412024-11-22T04:07:02.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 80c9bcd4-b9d5-4561-925b-ec5f644a0964 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69422024-11-22T04:07:02.947ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 80c9bcd4-b9d5-4561-925b-ec5f644a0964 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69432024-11-22T04:07:02.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2011 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 80c9bcd4-b9d5-4561-925b-ec5f644a0964 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69442024-11-22T04:07:03.967ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f704315c-7084-4ea6-b93d-fba187d10c1c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69452024-11-22T04:07:03.967ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f704315c-7084-4ea6-b93d-fba187d10c1c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69462024-11-22T04:07:03.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2731 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f704315c-7084-4ea6-b93d-fba187d10c1c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69472024-11-22T04:07:04.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e474ace-fb18-41b9-af5f-2951962ad477 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69482024-11-22T04:07:04.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e474ace-fb18-41b9-af5f-2951962ad477 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69492024-11-22T04:07:04.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2151 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e474ace-fb18-41b9-af5f-2951962ad477 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69502024-11-22T04:07:06.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6f0b2633-9a27-4cdc-b98d-4a8d2faba5ab roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69512024-11-22T04:07:06.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6f0b2633-9a27-4cdc-b98d-4a8d2faba5ab resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69522024-11-22T04:07:06.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6f0b2633-9a27-4cdc-b98d-4a8d2faba5ab response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69532024-11-22T04:07:07.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6675efdd-5015-4e85-921f-e6d8c3ce7012 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69542024-11-22T04:07:07.031ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6675efdd-5015-4e85-921f-e6d8c3ce7012 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69552024-11-22T04:07:07.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2153 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6675efdd-5015-4e85-921f-e6d8c3ce7012 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69562024-11-22T04:07:08.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6bd30709-8efa-4bf3-bd9f-1f518683dfe7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69572024-11-22T04:07:08.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6bd30709-8efa-4bf3-bd9f-1f518683dfe7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69582024-11-22T04:07:08.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6bd30709-8efa-4bf3-bd9f-1f518683dfe7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69592024-11-22T04:07:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
69602024-11-22T04:07:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
69612024-11-22T04:07:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69622024-11-22T04:07:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69632024-11-22T04:07:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69642024-11-22T04:07:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69652024-11-22T04:07:08.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69662024-11-22T04:07:08.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69672024-11-22T04:07:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69682024-11-22T04:07:08.443ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.883666ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69692024-11-22T04:07:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69702024-11-22T04:07:08.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69712024-11-22T04:07:08.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69722024-11-22T04:07:08.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69732024-11-22T04:07:08.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69742024-11-22T04:07:08.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69752024-11-22T04:07:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
69762024-11-22T04:07:08.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69772024-11-22T04:07:08.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69782024-11-22T04:07:08.462ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
69792024-11-22T04:07:08.462ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.862144ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
69802024-11-22T04:07:09.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3a3993fd-fcc3-4790-b881-80ab77c2af86 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69812024-11-22T04:07:09.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3a3993fd-fcc3-4790-b881-80ab77c2af86 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69822024-11-22T04:07:09.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2087 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3a3993fd-fcc3-4790-b881-80ab77c2af86 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69832024-11-22T04:07:10.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24937de6-3a65-48d1-bf8f-c62de0d146ac roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69842024-11-22T04:07:10.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24937de6-3a65-48d1-bf8f-c62de0d146ac resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69852024-11-22T04:07:10.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2224 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24937de6-3a65-48d1-bf8f-c62de0d146ac response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69862024-11-22T04:07:10.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 652 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 4fe827f5-5927-4797-ad6a-bdb3a8f5ce17 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
69872024-11-22T04:07:11.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34a62a35-5164-4cc0-8a5a-de05a71c08f9 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69882024-11-22T04:07:11.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34a62a35-5164-4cc0-8a5a-de05a71c08f9 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69892024-11-22T04:07:11.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2331 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34a62a35-5164-4cc0-8a5a-de05a71c08f9 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69902024-11-22T04:07:12.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f332e7ed-ba2c-44e5-bd7f-58747df60390 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69912024-11-22T04:07:12.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f332e7ed-ba2c-44e5-bd7f-58747df60390 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69922024-11-22T04:07:12.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f332e7ed-ba2c-44e5-bd7f-58747df60390 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69932024-11-22T04:07:13.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 59008e88-5447-4e31-bf35-5280b8e362fd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69942024-11-22T04:07:13.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 59008e88-5447-4e31-bf35-5280b8e362fd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69952024-11-22T04:07:13.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2274 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 59008e88-5447-4e31-bf35-5280b8e362fd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69962024-11-22T04:07:14.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39054499-e69e-42f3-8623-b9eff5aea271 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69972024-11-22T04:07:14.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39054499-e69e-42f3-8623-b9eff5aea271 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69982024-11-22T04:07:14.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2549 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39054499-e69e-42f3-8623-b9eff5aea271 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
69992024-11-22T04:07:15.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 69a9e086-a84e-46a9-afb2-22c1b29b2c5c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70002024-11-22T04:07:15.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 69a9e086-a84e-46a9-afb2-22c1b29b2c5c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70012024-11-22T04:07:15.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2570 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 69a9e086-a84e-46a9-afb2-22c1b29b2c5c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70022024-11-22T04:07:16.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 26c6e425-345d-4588-899a-95fcfd477b42 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70032024-11-22T04:07:16.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 26c6e425-345d-4588-899a-95fcfd477b42 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70042024-11-22T04:07:16.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2254 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 26c6e425-345d-4588-899a-95fcfd477b42 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70052024-11-22T04:07:17.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e08d91b0-d0b3-4e5c-bb8a-2e1b29732182 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70062024-11-22T04:07:17.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e08d91b0-d0b3-4e5c-bb8a-2e1b29732182 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70072024-11-22T04:07:17.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2496 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e08d91b0-d0b3-4e5c-bb8a-2e1b29732182 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70082024-11-22T04:07:18.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 67f15bd2-dcbb-40bd-8ec9-76be3459af7a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70092024-11-22T04:07:18.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 67f15bd2-dcbb-40bd-8ec9-76be3459af7a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70102024-11-22T04:07:18.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 67f15bd2-dcbb-40bd-8ec9-76be3459af7a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70112024-11-22T04:07:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
70122024-11-22T04:07:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
70132024-11-22T04:07:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70142024-11-22T04:07:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70152024-11-22T04:07:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70162024-11-22T04:07:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70172024-11-22T04:07:18.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70182024-11-22T04:07:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70192024-11-22T04:07:18.441ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70202024-11-22T04:07:18.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.867239ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70212024-11-22T04:07:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70222024-11-22T04:07:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70232024-11-22T04:07:18.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70242024-11-22T04:07:18.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70252024-11-22T04:07:18.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70262024-11-22T04:07:18.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70272024-11-22T04:07:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
70282024-11-22T04:07:18.450ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70292024-11-22T04:07:18.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70302024-11-22T04:07:18.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
70312024-11-22T04:07:18.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.049789ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
70322024-11-22T04:07:19.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65f7a6ee-04f9-4db8-b98b-1f8fec465e73 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70332024-11-22T04:07:19.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65f7a6ee-04f9-4db8-b98b-1f8fec465e73 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70342024-11-22T04:07:19.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1870 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65f7a6ee-04f9-4db8-b98b-1f8fec465e73 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70352024-11-22T04:07:20.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b616017-d190-42fb-80b7-b07820d72e79 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70362024-11-22T04:07:20.308ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b616017-d190-42fb-80b7-b07820d72e79 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70372024-11-22T04:07:20.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3b616017-d190-42fb-80b7-b07820d72e79 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70382024-11-22T04:07:20.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 514 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 08b1f0a1-b4e8-47fd-9e86-030122b47ff2 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
70392024-11-22T04:07:21.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 918b6d52-70bf-4a37-bba5-98d3168717bb roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70402024-11-22T04:07:21.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 918b6d52-70bf-4a37-bba5-98d3168717bb resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70412024-11-22T04:07:21.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2560 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 918b6d52-70bf-4a37-bba5-98d3168717bb response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70422024-11-22T04:07:22.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c5359ee7-fa38-4773-ad26-b2241a3e731b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70432024-11-22T04:07:22.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c5359ee7-fa38-4773-ad26-b2241a3e731b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70442024-11-22T04:07:22.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2177 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c5359ee7-fa38-4773-ad26-b2241a3e731b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70452024-11-22T04:07:23.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff14b52e-5fae-4cee-8089-25cb88d886e1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70462024-11-22T04:07:23.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff14b52e-5fae-4cee-8089-25cb88d886e1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70472024-11-22T04:07:23.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff14b52e-5fae-4cee-8089-25cb88d886e1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70482024-11-22T04:07:24.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1da8e0a-127c-4da8-8e06-38d0d236acba roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70492024-11-22T04:07:24.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1da8e0a-127c-4da8-8e06-38d0d236acba resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70502024-11-22T04:07:24.395ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2128 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b1da8e0a-127c-4da8-8e06-38d0d236acba response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70512024-11-22T04:07:25.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a72b7d9a-480e-4de9-942b-8eee40777a90 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70522024-11-22T04:07:25.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a72b7d9a-480e-4de9-942b-8eee40777a90 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70532024-11-22T04:07:25.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2405 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a72b7d9a-480e-4de9-942b-8eee40777a90 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70542024-11-22T04:07:25.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 5a08e13d-ebac-4161-b1c0-5a57cabb1e53 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
70552024-11-22T04:07:25.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 5a08e13d-ebac-4161-b1c0-5a57cabb1e53 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
70562024-11-22T04:07:25.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3228 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 5a08e13d-ebac-4161-b1c0-5a57cabb1e53 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
70572024-11-22T04:07:26.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 31fcd02c-fdd1-4e78-8d98-bb7e091ecedc roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70582024-11-22T04:07:26.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 31fcd02c-fdd1-4e78-8d98-bb7e091ecedc resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70592024-11-22T04:07:26.440ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2364 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 31fcd02c-fdd1-4e78-8d98-bb7e091ecedc response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70602024-11-22T04:07:27.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 253134d1-1c84-469a-8d3b-5b316a55fe42 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70612024-11-22T04:07:27.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 253134d1-1c84-469a-8d3b-5b316a55fe42 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70622024-11-22T04:07:27.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2294 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 253134d1-1c84-469a-8d3b-5b316a55fe42 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
70632024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
70642024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70652024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
70662024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
70672024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70682024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70692024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
70702024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
70712024-11-22T04:07:28.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70722024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70732024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
70742024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70752024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70762024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
70772024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
70782024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
70792024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70802024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
70812024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
70822024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70832024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70842024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
70852024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
70862024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
70872024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
70882024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70892024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70902024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
70912024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
70922024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70932024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
70942024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
70952024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70962024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70972024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70982024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70992024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71002024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71012024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71022024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71032024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71042024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71052024-11-22T04:07:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
71062024-11-22T04:07:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71072024-11-22T04:07:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71082024-11-22T04:07:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71092024-11-22T04:07:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71102024-11-22T04:07:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71112024-11-22T04:07:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
71122024-11-22T04:07:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71132024-11-22T04:07:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71142024-11-22T04:07:28.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1677, tv_nsec: 792425453 } })
71152024-11-22T04:07:28.441ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71162024-11-22T04:07:28.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.246458ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71172024-11-22T04:07:28.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
71182024-11-22T04:07:28.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71192024-11-22T04:07:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71202024-11-22T04:07:28.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71212024-11-22T04:07:28.443ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71222024-11-22T04:07:28.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71232024-11-22T04:07:28.445ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71242024-11-22T04:07:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
71252024-11-22T04:07:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71262024-11-22T04:07:28.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71272024-11-22T04:07:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71282024-11-22T04:07:28.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71292024-11-22T04:07:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71302024-11-22T04:07:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71312024-11-22T04:07:28.446ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1677, tv_nsec: 797710277 } })
71322024-11-22T04:07:28.446ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
71332024-11-22T04:07:28.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71342024-11-22T04:07:28.448ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71352024-11-22T04:07:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71362024-11-22T04:07:28.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.661449ms iteration = 26 status = {"errors":[],"records_set_to_done":[]}
71372024-11-22T04:07:28.449ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71382024-11-22T04:07:28.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71392024-11-22T04:07:28.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71402024-11-22T04:07:28.449ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71412024-11-22T04:07:28.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71422024-11-22T04:07:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71432024-11-22T04:07:28.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71442024-11-22T04:07:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71452024-11-22T04:07:28.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71462024-11-22T04:07:28.451ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71472024-11-22T04:07:28.452ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71482024-11-22T04:07:28.452ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71492024-11-22T04:07:28.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71502024-11-22T04:07:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71512024-11-22T04:07:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71522024-11-22T04:07:28.453ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.353953ms iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
71532024-11-22T04:07:28.455ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71542024-11-22T04:07:28.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71552024-11-22T04:07:28.455ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.978241ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71562024-11-22T04:07:28.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71572024-11-22T04:07:28.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71582024-11-22T04:07:28.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71592024-11-22T04:07:28.457ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71602024-11-22T04:07:28.457ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71612024-11-22T04:07:28.457ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71622024-11-22T04:07:28.457ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1677, tv_nsec: 808616731 } })
71632024-11-22T04:07:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71642024-11-22T04:07:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71652024-11-22T04:07:28.457ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
71662024-11-22T04:07:28.462ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71672024-11-22T04:07:28.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
71682024-11-22T04:07:28.464ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71692024-11-22T04:07:28.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71702024-11-22T04:07:28.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 832d7b44-b2f5-4c25-8b2d-0df45dbfe298 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
71712024-11-22T04:07:28.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 832d7b44-b2f5-4c25-8b2d-0df45dbfe298 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
71722024-11-22T04:07:28.484ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 46.132288ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
71732024-11-22T04:07:28.487ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71742024-11-22T04:07:28.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71752024-11-22T04:07:28.489ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71762024-11-22T04:07:28.489ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71772024-11-22T04:07:28.489ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 51.198339ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71782024-11-22T04:07:28.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
71792024-11-22T04:07:28.492ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71802024-11-22T04:07:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71812024-11-22T04:07:28.495ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71822024-11-22T04:07:28.495ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71832024-11-22T04:07:28.495ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71842024-11-22T04:07:28.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71852024-11-22T04:07:28.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71862024-11-22T04:07:28.503ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71872024-11-22T04:07:28.503ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71882024-11-22T04:07:28.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71892024-11-22T04:07:28.531ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71902024-11-22T04:07:28.531ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71912024-11-22T04:07:28.531ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4cc4062-94d9-4fca-85f9-74af272353c0", "content-length": "26", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
71922024-11-22T04:07:28.531ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71932024-11-22T04:07:28.533ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71942024-11-22T04:07:28.545ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
71952024-11-22T04:07:28.545ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
71962024-11-22T04:07:28.546ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d14d9ab-a53d-46d8-b75e-b692973cac72", "content-length": "26", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
71972024-11-22T04:07:28.546ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
71982024-11-22T04:07:28.547ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
71992024-11-22T04:07:28.548ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72002024-11-22T04:07:28.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72012024-11-22T04:07:28.559ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
72022024-11-22T04:07:28.559ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72032024-11-22T04:07:28.559ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a038dcaa-05fd-4f97-a547-59d5244c324e", "content-length": "26", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
72042024-11-22T04:07:28.559ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72052024-11-22T04:07:28.561ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
72062024-11-22T04:07:28.577ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72072024-11-22T04:07:28.577ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72082024-11-22T04:07:28.577ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9005d9f5-616e-45ae-92bb-980688d24fe3", "content-length": "372", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
72092024-11-22T04:07:28.577ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72102024-11-22T04:07:28.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72112024-11-22T04:07:28.579ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100111 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 832d7b44-b2f5-4c25-8b2d-0df45dbfe298 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
72122024-11-22T04:07:28.580ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72132024-11-22T04:07:28.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72142024-11-22T04:07:28.580ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 142.330116ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
72152024-11-22T04:07:28.589ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
72162024-11-22T04:07:28.589ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 151.253754ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
72172024-11-22T04:07:28.611ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72182024-11-22T04:07:28.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72192024-11-22T04:07:28.613ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72202024-11-22T04:07:28.613ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72212024-11-22T04:07:28.613ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 175.467833ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72222024-11-22T04:07:28.621ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72232024-11-22T04:07:28.624ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
72242024-11-22T04:07:28.624ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72252024-11-22T04:07:28.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72262024-11-22T04:07:28.626ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 188.041776ms iteration = 26 status = 0
72272024-11-22T04:07:28.634ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
72282024-11-22T04:07:28.634ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72292024-11-22T04:07:28.635ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d23bde0b-d8c3-4548-8679-4afdc268193b", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
72302024-11-22T04:07:28.635ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72312024-11-22T04:07:28.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72322024-11-22T04:07:28.637ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72332024-11-22T04:07:28.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72342024-11-22T04:07:28.637ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72352024-11-22T04:07:28.638ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d685b88-a24e-4a8f-8c95-801fc7556b16", "content-length": "2", "date": "Fri, 22 Nov 2024 04:07:27 GMT"} })
72362024-11-22T04:07:28.640ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 201.636358ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
72372024-11-22T04:07:28.640ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72382024-11-22T04:07:28.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72392024-11-22T04:07:28.640ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72402024-11-22T04:07:28.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72412024-11-22T04:07:28.642ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.656581ms iteration = 26 status = null
72422024-11-22T04:07:28.644ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72432024-11-22T04:07:28.644ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72442024-11-22T04:07:28.645ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "5820d678-8195-4762-bc01-a4eb95dcf503", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
72452024-11-22T04:07:28.647ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 209.63412ms iteration = 27 status = {}
72462024-11-22T04:07:28.692ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 254.381504ms iteration = 26 status = {}
72472024-11-22T04:07:28.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72482024-11-22T04:07:28.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72492024-11-22T04:07:28.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72502024-11-22T04:07:28.726ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 288.169274ms iteration = 29 status = {"physical_disks_added":0}
72512024-11-22T04:07:28.727ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72522024-11-22T04:07:28.727ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72532024-11-22T04:07:28.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72542024-11-22T04:07:28.728ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72552024-11-22T04:07:28.730ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72562024-11-22T04:07:28.730ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72572024-11-22T04:07:28.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72582024-11-22T04:07:28.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72592024-11-22T04:07:28.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72602024-11-22T04:07:28.781ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
72612024-11-22T04:07:28.781ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72622024-11-22T04:07:28.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72632024-11-22T04:07:28.793ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72642024-11-22T04:07:28.794ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5683878e-5f58-4df9-bf4f-cae16f676315", "content-length": "134", "date": "Fri, 22 Nov 2024 04:07:27 GMT"} })
72652024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72662024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
72672024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72682024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72692024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72702024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72712024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72722024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72732024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72742024-11-22T04:07:28.794ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72752024-11-22T04:07:28.795ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
72762024-11-22T04:07:28.795ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72772024-11-22T04:07:28.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72782024-11-22T04:07:28.797ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72792024-11-22T04:07:28.797ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4192e38-471f-4a74-b8be-dc8559214c32", "content-length": "2", "date": "Fri, 22 Nov 2024 04:07:27 GMT"} })
72802024-11-22T04:07:28.797ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72812024-11-22T04:07:28.797ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "213afa7d-b958-4da4-bf81-c764fd9d2779", "content-length": "52", "date": "Fri, 22 Nov 2024 04:07:27 GMT"} })
72822024-11-22T04:07:28.797ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
72832024-11-22T04:07:28.797ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72842024-11-22T04:07:28.833ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72852024-11-22T04:07:28.834ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7fa38f00-2aa3-4f6f-b153-b8491441ec55", "content-length": "691", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
72862024-11-22T04:07:28.834ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
72872024-11-22T04:07:28.834ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
72882024-11-22T04:07:28.834ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
72892024-11-22T04:07:28.835ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 397.003354ms iteration = 27 status = {}
72902024-11-22T04:07:28.941ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d792eaa9-2491-4d33-b9b2-af9faaddc2b1", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
72912024-11-22T04:07:28.941ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
72922024-11-22T04:07:28.941ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72932024-11-22T04:07:28.941ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "967ffc6c-9cfb-42c1-8ebe-fe38b1157c0f", "content-length": "682", "date": "Fri, 22 Nov 2024 04:07:28 GMT"} })
72942024-11-22T04:07:28.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72952024-11-22T04:07:28.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72962024-11-22T04:07:28.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72972024-11-22T04:07:28.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72982024-11-22T04:07:28.950ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72992024-11-22T04:07:28.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73002024-11-22T04:07:28.953ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73012024-11-22T04:07:28.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73022024-11-22T04:07:28.963ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 525.361011ms iteration = 26 status = {}
73032024-11-22T04:07:29.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2778b8e1-6cc4-418f-a760-008ae670026a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73042024-11-22T04:07:29.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2778b8e1-6cc4-418f-a760-008ae670026a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73052024-11-22T04:07:29.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2778b8e1-6cc4-418f-a760-008ae670026a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73062024-11-22T04:07:30.622ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 610f721c-633d-4da4-b18b-3dc79b323f66 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73072024-11-22T04:07:30.622ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 610f721c-633d-4da4-b18b-3dc79b323f66 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73082024-11-22T04:07:30.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2615 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 610f721c-633d-4da4-b18b-3dc79b323f66 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73092024-11-22T04:07:30.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 544 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 7bf5616c-3720-4e1c-be64-8c2e481bf573 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
73102024-11-22T04:07:31.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f3a41d78-d60b-4fef-968f-ced2d2d60d29 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73112024-11-22T04:07:31.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f3a41d78-d60b-4fef-968f-ced2d2d60d29 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73122024-11-22T04:07:31.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1801 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f3a41d78-d60b-4fef-968f-ced2d2d60d29 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73132024-11-22T04:07:32.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 42121177-a8db-43ee-987d-4866298987f1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73142024-11-22T04:07:32.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 42121177-a8db-43ee-987d-4866298987f1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73152024-11-22T04:07:32.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2764 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 42121177-a8db-43ee-987d-4866298987f1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73162024-11-22T04:07:33.684ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bfa46a70-e80b-47cf-9d84-76d18965e4c7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73172024-11-22T04:07:33.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bfa46a70-e80b-47cf-9d84-76d18965e4c7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73182024-11-22T04:07:33.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2691 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = bfa46a70-e80b-47cf-9d84-76d18965e4c7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73192024-11-22T04:07:34.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9c0513e-0c53-47d4-bcab-347c64e1ec66 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73202024-11-22T04:07:34.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9c0513e-0c53-47d4-bcab-347c64e1ec66 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73212024-11-22T04:07:34.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2185 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a9c0513e-0c53-47d4-bcab-347c64e1ec66 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73222024-11-22T04:07:35.727ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 47ecbc15-07fc-4302-a310-663a48dc82d1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73232024-11-22T04:07:35.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 47ecbc15-07fc-4302-a310-663a48dc82d1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73242024-11-22T04:07:35.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 47ecbc15-07fc-4302-a310-663a48dc82d1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73252024-11-22T04:07:36.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5db4a516-1377-4a3c-a298-3405c6bfeac7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73262024-11-22T04:07:36.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5db4a516-1377-4a3c-a298-3405c6bfeac7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73272024-11-22T04:07:36.751ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2147 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5db4a516-1377-4a3c-a298-3405c6bfeac7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73282024-11-22T04:07:37.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f7032027-abdb-4c6a-8158-29d180b1a7be roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73292024-11-22T04:07:37.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f7032027-abdb-4c6a-8158-29d180b1a7be resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73302024-11-22T04:07:37.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2059 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f7032027-abdb-4c6a-8158-29d180b1a7be response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73312024-11-22T04:07:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
73322024-11-22T04:07:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
73332024-11-22T04:07:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73342024-11-22T04:07:38.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73352024-11-22T04:07:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73362024-11-22T04:07:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73372024-11-22T04:07:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73382024-11-22T04:07:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73392024-11-22T04:07:38.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73402024-11-22T04:07:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73412024-11-22T04:07:38.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73422024-11-22T04:07:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73432024-11-22T04:07:38.472ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73442024-11-22T04:07:38.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73452024-11-22T04:07:38.474ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.956248ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73462024-11-22T04:07:38.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73472024-11-22T04:07:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
73482024-11-22T04:07:38.478ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73492024-11-22T04:07:38.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73502024-11-22T04:07:38.489ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
73512024-11-22T04:07:38.489ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.663586ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
73522024-11-22T04:07:38.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1c52dc96-fc3f-4404-8299-fdfd235df017 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73532024-11-22T04:07:38.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1c52dc96-fc3f-4404-8299-fdfd235df017 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73542024-11-22T04:07:38.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1779 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1c52dc96-fc3f-4404-8299-fdfd235df017 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73552024-11-22T04:07:39.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c18263d-56f6-4140-90c3-e4854e8f4f72 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73562024-11-22T04:07:39.814ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c18263d-56f6-4140-90c3-e4854e8f4f72 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73572024-11-22T04:07:39.815ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2120 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5c18263d-56f6-4140-90c3-e4854e8f4f72 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73582024-11-22T04:07:40.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 611 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = f9f0bb35-0d65-4b33-aa6d-34058ab56f7d response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
73592024-11-22T04:07:40.835ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 929a600b-3396-4da9-bd2e-af556096373b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73602024-11-22T04:07:40.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 929a600b-3396-4da9-bd2e-af556096373b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73612024-11-22T04:07:40.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1659 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 929a600b-3396-4da9-bd2e-af556096373b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73622024-11-22T04:07:41.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a79f3c1c-f63f-46d7-aabc-ac7c27a29316 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73632024-11-22T04:07:41.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a79f3c1c-f63f-46d7-aabc-ac7c27a29316 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73642024-11-22T04:07:41.858ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2420 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a79f3c1c-f63f-46d7-aabc-ac7c27a29316 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73652024-11-22T04:07:42.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dcc78630-6fd9-4eee-98ad-4a5512a24991 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73662024-11-22T04:07:42.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dcc78630-6fd9-4eee-98ad-4a5512a24991 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73672024-11-22T04:07:42.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2510 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dcc78630-6fd9-4eee-98ad-4a5512a24991 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73682024-11-22T04:07:43.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86922629-9ccb-4949-ad38-7f6d46922c62 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73692024-11-22T04:07:43.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86922629-9ccb-4949-ad38-7f6d46922c62 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73702024-11-22T04:07:43.901ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2347 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86922629-9ccb-4949-ad38-7f6d46922c62 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73712024-11-22T04:07:44.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78897c4d-9510-41b0-b754-a7dc23f54fbb roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73722024-11-22T04:07:44.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78897c4d-9510-41b0-b754-a7dc23f54fbb resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73732024-11-22T04:07:44.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2632 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78897c4d-9510-41b0-b754-a7dc23f54fbb response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73742024-11-22T04:07:45.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95f22861-2b37-406b-9508-b55382f06891 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73752024-11-22T04:07:45.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95f22861-2b37-406b-9508-b55382f06891 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73762024-11-22T04:07:45.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2042 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95f22861-2b37-406b-9508-b55382f06891 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73772024-11-22T04:07:46.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 76ae4260-b9e3-46d7-af76-4a0c029bfaa4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73782024-11-22T04:07:46.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 76ae4260-b9e3-46d7-af76-4a0c029bfaa4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73792024-11-22T04:07:46.966ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2333 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 76ae4260-b9e3-46d7-af76-4a0c029bfaa4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73802024-11-22T04:07:47.986ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a1fef85d-52b4-437c-a445-d65e15845374 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73812024-11-22T04:07:47.986ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a1fef85d-52b4-437c-a445-d65e15845374 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73822024-11-22T04:07:47.988ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2220 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a1fef85d-52b4-437c-a445-d65e15845374 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
73832024-11-22T04:07:48.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
73842024-11-22T04:07:48.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
73852024-11-22T04:07:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73862024-11-22T04:07:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73872024-11-22T04:07:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73882024-11-22T04:07:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73892024-11-22T04:07:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73902024-11-22T04:07:48.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73912024-11-22T04:07:48.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73922024-11-22T04:07:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73932024-11-22T04:07:48.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73942024-11-22T04:07:48.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73952024-11-22T04:07:48.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73962024-11-22T04:07:48.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73972024-11-22T04:07:48.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73982024-11-22T04:07:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
73992024-11-22T04:07:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74002024-11-22T04:07:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74012024-11-22T04:07:48.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
74022024-11-22T04:07:48.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.006609ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
74032024-11-22T04:07:48.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.43131ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74042024-11-22T04:07:49.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 00f2c9ce-f63f-410b-b1a9-55cb802006d3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74052024-11-22T04:07:49.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 00f2c9ce-f63f-410b-b1a9-55cb802006d3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74062024-11-22T04:07:49.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2146 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 00f2c9ce-f63f-410b-b1a9-55cb802006d3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74072024-11-22T04:07:50.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34afac4c-4434-4c08-b622-377e214015f5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74082024-11-22T04:07:50.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34afac4c-4434-4c08-b622-377e214015f5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74092024-11-22T04:07:50.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1926 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 34afac4c-4434-4c08-b622-377e214015f5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74102024-11-22T04:07:50.632ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 529 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 78e2a2eb-938d-434c-8d30-a9e9fc63e77c response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
74112024-11-22T04:07:51.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9d978af5-595b-41d6-8ad3-762a5ac39e12 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74122024-11-22T04:07:51.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9d978af5-595b-41d6-8ad3-762a5ac39e12 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74132024-11-22T04:07:51.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2494 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9d978af5-595b-41d6-8ad3-762a5ac39e12 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74142024-11-22T04:07:52.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ef204ccb-1bbd-4449-99ea-95f5a980cacf roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74152024-11-22T04:07:52.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ef204ccb-1bbd-4449-99ea-95f5a980cacf resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74162024-11-22T04:07:52.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2455 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ef204ccb-1bbd-4449-99ea-95f5a980cacf response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74172024-11-22T04:07:53.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27261203-f42b-457a-a897-2217552fe095 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74182024-11-22T04:07:53.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27261203-f42b-457a-a897-2217552fe095 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74192024-11-22T04:07:53.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27261203-f42b-457a-a897-2217552fe095 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74202024-11-22T04:07:54.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ae739631-b7ff-438c-b4e2-14484ce8887e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74212024-11-22T04:07:54.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ae739631-b7ff-438c-b4e2-14484ce8887e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74222024-11-22T04:07:54.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2844 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ae739631-b7ff-438c-b4e2-14484ce8887e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74232024-11-22T04:07:55.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6f20fd36-51a3-480b-8cf7-db337f35eec3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74242024-11-22T04:07:55.137ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6f20fd36-51a3-480b-8cf7-db337f35eec3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74252024-11-22T04:07:55.139ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6f20fd36-51a3-480b-8cf7-db337f35eec3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74262024-11-22T04:07:55.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = bc5a72a7-1ec3-4502-973f-31ec760ade1f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
74272024-11-22T04:07:55.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = bc5a72a7-1ec3-4502-973f-31ec760ade1f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
74282024-11-22T04:07:55.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3295 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = bc5a72a7-1ec3-4502-973f-31ec760ade1f response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
74292024-11-22T04:07:56.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d56f49b2-8c87-45ba-94e3-3a6554c4a925 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74302024-11-22T04:07:56.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d56f49b2-8c87-45ba-94e3-3a6554c4a925 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74312024-11-22T04:07:56.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2234 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d56f49b2-8c87-45ba-94e3-3a6554c4a925 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74322024-11-22T04:07:57.180ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f889985b-8e39-4e74-aa81-916f9c6da405 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74332024-11-22T04:07:57.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f889985b-8e39-4e74-aa81-916f9c6da405 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74342024-11-22T04:07:57.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2278 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f889985b-8e39-4e74-aa81-916f9c6da405 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74352024-11-22T04:07:58.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 354271eb-cc70-4fcb-91a4-23dd9a333d78 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74362024-11-22T04:07:58.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 354271eb-cc70-4fcb-91a4-23dd9a333d78 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74372024-11-22T04:07:58.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 354271eb-cc70-4fcb-91a4-23dd9a333d78 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
74382024-11-22T04:07:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
74392024-11-22T04:07:58.436ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
74402024-11-22T04:07:58.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74412024-11-22T04:07:58.436ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
74422024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74432024-11-22T04:07:58.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1707, tv_nsec: 788462573 } })
74442024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
74452024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
74462024-11-22T04:07:58.437ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
74472024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74482024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.7\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
74492024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
74502024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
74512024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74522024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
74532024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74542024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
74552024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
74562024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74572024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
74582024-11-22T04:07:58.437ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74592024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
74602024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74612024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
74622024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
74632024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74642024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
74652024-11-22T04:07:58.438ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
74662024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
74672024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74682024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
74692024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
74702024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
74712024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
74722024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74732024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
74742024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
74752024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74762024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
74772024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
74782024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
74792024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74802024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
74812024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
74822024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
74832024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74842024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
74852024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
74862024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74872024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
74882024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74892024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
74902024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74912024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
74922024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.335254ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
74932024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74942024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
74952024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
74962024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
74972024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74982024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
74992024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75002024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
75012024-11-22T04:07:58.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
75022024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75032024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
75042024-11-22T04:07:58.438ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:57:58.438270895 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
75052024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
75062024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75072024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75082024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
75092024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75102024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
75112024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75122024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
75132024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75142024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75152024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75162024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
75172024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75182024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75192024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
75202024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75212024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
75222024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75232024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
75242024-11-22T04:07:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1707, tv_nsec: 789716786 } })
75252024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75262024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75272024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75282024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
75292024-11-22T04:07:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75302024-11-22T04:07:58.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
75312024-11-22T04:07:58.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 945.917\u{b5}s iteration = 14 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
75322024-11-22T04:07:58.440ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75332024-11-22T04:07:58.440ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75342024-11-22T04:07:58.440ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75352024-11-22T04:07:58.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75362024-11-22T04:07:58.440ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75372024-11-22T04:07:58.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1707, tv_nsec: 792632207 } })
75382024-11-22T04:07:58.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
75392024-11-22T04:07:58.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.983741ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
75402024-11-22T04:07:58.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1707, tv_nsec: 793617265 } })
75412024-11-22T04:07:58.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
75422024-11-22T04:07:58.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75432024-11-22T04:07:58.446ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75442024-11-22T04:07:58.446ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75452024-11-22T04:07:58.446ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75462024-11-22T04:07:58.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75472024-11-22T04:07:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75482024-11-22T04:07:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75492024-11-22T04:07:58.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.452817ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
75502024-11-22T04:07:58.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75512024-11-22T04:07:58.449ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75522024-11-22T04:07:58.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75532024-11-22T04:07:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
75542024-11-22T04:07:58.450ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
75552024-11-22T04:07:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
75562024-11-22T04:07:58.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75572024-11-22T04:07:58.452ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.834873ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
75582024-11-22T04:07:58.453ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:57:58.438270895 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
75592024-11-22T04:07:58.453ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.544326ms iteration = 14 status = {"expiration":"2024-11-22T03:57:58.438270895Z","pruned":[]}
75602024-11-22T04:07:58.454ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75612024-11-22T04:07:58.456ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
75622024-11-22T04:07:58.456ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75632024-11-22T04:07:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75642024-11-22T04:07:58.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75652024-11-22T04:07:58.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75662024-11-22T04:07:58.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75672024-11-22T04:07:58.461ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75682024-11-22T04:07:58.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75692024-11-22T04:07:58.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75702024-11-22T04:07:58.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75712024-11-22T04:07:58.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75722024-11-22T04:07:58.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75732024-11-22T04:07:58.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75742024-11-22T04:07:58.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
75752024-11-22T04:07:58.472ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75762024-11-22T04:07:58.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75772024-11-22T04:07:58.483ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
75782024-11-22T04:07:58.483ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
75792024-11-22T04:07:58.483ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
75802024-11-22T04:07:58.483ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75812024-11-22T04:07:58.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75822024-11-22T04:07:58.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75832024-11-22T04:07:58.489ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 51.088616ms iteration = 27 status = {"errors":[],"records_set_to_done":[]}
75842024-11-22T04:07:58.490ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75852024-11-22T04:07:58.490ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75862024-11-22T04:07:58.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75872024-11-22T04:07:58.491ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882024-11-22T04:07:58.491ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
75892024-11-22T04:07:58.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
75902024-11-22T04:07:58.493ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.631837ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75912024-11-22T04:07:58.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75922024-11-22T04:07:58.493ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75932024-11-22T04:07:58.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75942024-11-22T04:07:58.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75952024-11-22T04:07:58.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75962024-11-22T04:07:58.497ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
75972024-11-22T04:07:58.497ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
75982024-11-22T04:07:58.497ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 59.793051ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
75992024-11-22T04:07:58.499ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76002024-11-22T04:07:58.501ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
76012024-11-22T04:07:58.501ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
76022024-11-22T04:07:58.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
76032024-11-22T04:07:58.505ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
76042024-11-22T04:07:58.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
76052024-11-22T04:07:58.507ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76062024-11-22T04:07:58.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76072024-11-22T04:07:58.510ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76082024-11-22T04:07:58.510ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
76092024-11-22T04:07:58.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
76102024-11-22T04:07:58.510ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76112024-11-22T04:07:58.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
76122024-11-22T04:07:58.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76132024-11-22T04:07:58.510ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
76142024-11-22T04:07:58.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76152024-11-22T04:07:58.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76162024-11-22T04:07:58.511ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
76172024-11-22T04:07:58.511ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
76182024-11-22T04:07:58.511ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.607586ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
76192024-11-22T04:07:58.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
76202024-11-22T04:07:58.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76212024-11-22T04:07:58.513ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
76222024-11-22T04:07:58.513ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76232024-11-22T04:07:58.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76242024-11-22T04:07:58.513ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
76252024-11-22T04:07:58.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76262024-11-22T04:07:58.513ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
76272024-11-22T04:07:58.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
76282024-11-22T04:07:58.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
76292024-11-22T04:07:58.514ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
76302024-11-22T04:07:58.514ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
76312024-11-22T04:07:58.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
76322024-11-22T04:07:58.516ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1707, tv_nsec: 867379574 } })
76332024-11-22T04:07:58.516ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
76342024-11-22T04:07:58.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76352024-11-22T04:07:58.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76362024-11-22T04:07:58.520ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76372024-11-22T04:07:58.522ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
76382024-11-22T04:07:58.522ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76392024-11-22T04:07:58.522ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
76402024-11-22T04:07:58.522ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
76412024-11-22T04:07:58.522ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
76422024-11-22T04:07:58.522ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76432024-11-22T04:07:58.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76442024-11-22T04:07:58.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76452024-11-22T04:07:58.524ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76462024-11-22T04:07:58.528ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76472024-11-22T04:07:58.528ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76482024-11-22T04:07:58.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76492024-11-22T04:07:58.532ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
76502024-11-22T04:07:58.532ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.037949ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
76512024-11-22T04:07:58.534ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76522024-11-22T04:07:58.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76532024-11-22T04:07:58.535ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
76542024-11-22T04:07:58.535ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
76552024-11-22T04:07:58.535ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76562024-11-22T04:07:58.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76572024-11-22T04:07:58.536ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76582024-11-22T04:07:58.537ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
76592024-11-22T04:07:58.537ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 99.74828ms iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
76602024-11-22T04:07:58.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
76612024-11-22T04:07:58.538ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76622024-11-22T04:07:58.538ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76632024-11-22T04:07:58.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76642024-11-22T04:07:58.541ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76652024-11-22T04:07:58.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76662024-11-22T04:07:58.544ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76672024-11-22T04:07:58.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
76682024-11-22T04:07:58.558ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.670201ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
76692024-11-22T04:07:58.561ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76702024-11-22T04:07:58.561ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76712024-11-22T04:07:58.561ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 123.742036ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76722024-11-22T04:07:58.575ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 136.92008ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
76732024-11-22T04:07:58.575ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
76742024-11-22T04:07:58.575ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.729275ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
76752024-11-22T04:07:58.576ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
76762024-11-22T04:07:58.576ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
76772024-11-22T04:07:58.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76782024-11-22T04:07:58.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76792024-11-22T04:07:58.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76802024-11-22T04:07:58.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76812024-11-22T04:07:58.581ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76822024-11-22T04:07:58.581ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76832024-11-22T04:07:58.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76842024-11-22T04:07:58.584ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
76852024-11-22T04:07:58.584ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
76862024-11-22T04:07:58.584ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76872024-11-22T04:07:58.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76882024-11-22T04:07:58.586ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
76892024-11-22T04:07:58.586ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
76902024-11-22T04:07:58.586ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
76912024-11-22T04:07:58.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 148.474625ms iteration = 14 status = {"generation":2}
76922024-11-22T04:07:58.587ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
76932024-11-22T04:07:58.587ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
76942024-11-22T04:07:58.587ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
76952024-11-22T04:07:58.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 150.99011ms iteration = 14 status = {"generation":1}
76962024-11-22T04:07:58.592ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76972024-11-22T04:07:58.594ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
76982024-11-22T04:07:58.594ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
76992024-11-22T04:07:58.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77002024-11-22T04:07:58.595ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) }
77012024-11-22T04:07:58.595ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.673298ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
77022024-11-22T04:07:58.606ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77032024-11-22T04:07:58.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77042024-11-22T04:07:58.615ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 177.5442ms iteration = 30 status = {"physical_disks_added":0}
77052024-11-22T04:07:58.619ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77062024-11-22T04:07:58.619ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77072024-11-22T04:07:58.619ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9170b2a-df73-414f-bb60-19465ad110e1", "content-length": "26", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
77082024-11-22T04:07:58.619ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77092024-11-22T04:07:58.621ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77102024-11-22T04:07:58.652ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
77112024-11-22T04:07:58.652ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 214.316383ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
77122024-11-22T04:07:58.707ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
77132024-11-22T04:07:58.770ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
77142024-11-22T04:07:58.770ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77152024-11-22T04:07:58.771ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b34ab41f-7a8a-4d5d-91bf-3bf08ac0cc1a", "content-length": "26", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
77162024-11-22T04:07:58.771ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77172024-11-22T04:07:58.772ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
77182024-11-22T04:07:58.787ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
77192024-11-22T04:07:58.787ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
77202024-11-22T04:07:58.787ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9e1b9218-28ad-4d67-885b-0a7d28ccc7d7", "content-length": "26", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
77212024-11-22T04:07:58.787ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
77222024-11-22T04:07:58.790ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
77232024-11-22T04:07:58.913ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
77242024-11-22T04:07:58.913ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77252024-11-22T04:07:58.915ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 476.924642ms iteration = 27 status = 0
77262024-11-22T04:07:58.918ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d66f6f38-2af1-49e2-ad50-10bf89575bd0", "content-length": "372", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
77272024-11-22T04:07:58.918ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77282024-11-22T04:07:58.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77292024-11-22T04:07:58.920ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
77302024-11-22T04:07:58.920ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
77312024-11-22T04:07:58.920ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a2d5b9a0-3cf9-48b5-84ac-62154b2fe66c", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77322024-11-22T04:07:58.921ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77332024-11-22T04:07:58.922ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "eb983dcb-5030-46f3-8663-5558960b135b", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77342024-11-22T04:07:58.922ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77352024-11-22T04:07:58.924ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
77362024-11-22T04:07:58.924ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 486.526002ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
77372024-11-22T04:07:58.942ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
77382024-11-22T04:07:58.942ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0441046-0b9d-41a7-8f54-8b55a0f64807", "content-length": "2", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
77392024-11-22T04:07:58.944ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77402024-11-22T04:07:58.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77412024-11-22T04:07:58.946ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 508.639665ms iteration = 27 status = null
77422024-11-22T04:07:58.951ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77432024-11-22T04:07:58.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77442024-11-22T04:07:58.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77452024-11-22T04:07:58.956ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77462024-11-22T04:07:58.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77472024-11-22T04:07:58.956ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77482024-11-22T04:07:58.962ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 525.078487ms iteration = 27 status = {}
77492024-11-22T04:07:58.968ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
77502024-11-22T04:07:58.968ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
77512024-11-22T04:07:58.969ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a319a8ed-fe86-4b76-ba99-7c2ef7e6a87f", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
77522024-11-22T04:07:58.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77532024-11-22T04:07:58.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77542024-11-22T04:07:58.975ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77552024-11-22T04:07:58.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77562024-11-22T04:07:58.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77572024-11-22T04:07:58.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77582024-11-22T04:07:58.983ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
77592024-11-22T04:07:58.983ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
77602024-11-22T04:07:58.983ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "84663d39-824b-4713-8b4a-a0b20617aba1", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
77612024-11-22T04:07:58.985ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 547.549865ms iteration = 28 status = {}
77622024-11-22T04:07:58.988ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77632024-11-22T04:07:58.989ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "354635a3-306e-4707-94ea-0d59e73f4e95", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77642024-11-22T04:07:58.989ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77652024-11-22T04:07:58.990ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b2e62cbb-46c2-4726-91a0-be02f7f30f38", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77662024-11-22T04:07:58.990ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77672024-11-22T04:07:58.992ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77682024-11-22T04:07:58.993ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d49ce3a1-c153-4759-83fd-e3e40bcd71ef", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77692024-11-22T04:07:58.993ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77702024-11-22T04:07:58.994ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
77712024-11-22T04:07:58.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77722024-11-22T04:07:58.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77732024-11-22T04:07:58.995ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77742024-11-22T04:07:58.995ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 556.912161ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
77752024-11-22T04:07:59.134ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77762024-11-22T04:07:59.135ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "53dc0df0-2348-4ba3-a6a4-dbddb217bd6f", "content-length": "691", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
77772024-11-22T04:07:59.135ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
77782024-11-22T04:07:59.135ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
77792024-11-22T04:07:59.135ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
77802024-11-22T04:07:59.137ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 699.255547ms iteration = 28 status = {}
77812024-11-22T04:07:59.148ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77822024-11-22T04:07:59.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77832024-11-22T04:07:59.150ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
77842024-11-22T04:07:59.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77852024-11-22T04:07:59.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77862024-11-22T04:07:59.157ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77872024-11-22T04:07:59.157ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef37b7e-2ce9-4a5e-ac52-e66d4dcd32a0", "content-length": "134", "date": "Fri, 22 Nov 2024 04:07:59 GMT"} })
77882024-11-22T04:07:59.157ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77892024-11-22T04:07:59.157ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
77902024-11-22T04:07:59.157ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77912024-11-22T04:07:59.157ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77922024-11-22T04:07:59.157ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77932024-11-22T04:07:59.157ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77942024-11-22T04:07:59.157ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77952024-11-22T04:07:59.157ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77962024-11-22T04:07:59.158ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77972024-11-22T04:07:59.158ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77982024-11-22T04:07:59.158ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
77992024-11-22T04:07:59.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78002024-11-22T04:07:59.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78012024-11-22T04:07:59.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
78022024-11-22T04:07:59.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "febb263e-c8f7-4520-a182-3e4d6dac358f", "content-length": "2", "date": "Fri, 22 Nov 2024 04:07:59 GMT"} })
78032024-11-22T04:07:59.159ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
78042024-11-22T04:07:59.159ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "504ab759-ab8e-4e74-80e2-7d38cfca8390", "content-length": "52", "date": "Fri, 22 Nov 2024 04:07:59 GMT"} })
78052024-11-22T04:07:59.159ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
78062024-11-22T04:07:59.159ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
78072024-11-22T04:07:59.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8ab8a496-6ba7-4074-bf3c-a59446f949df roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78082024-11-22T04:07:59.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8ab8a496-6ba7-4074-bf3c-a59446f949df resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78092024-11-22T04:07:59.236ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2507 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8ab8a496-6ba7-4074-bf3c-a59446f949df response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78102024-11-22T04:07:59.321ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "db32acdf-09e7-4c77-a2c1-8441283ae3b7", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
78112024-11-22T04:07:59.321ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
78122024-11-22T04:07:59.321ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78132024-11-22T04:07:59.321ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "02dfb16c-f6dc-4f3e-a4b3-60be3f950f92", "content-length": "682", "date": "Fri, 22 Nov 2024 04:07:58 GMT"} })
78142024-11-22T04:07:59.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78152024-11-22T04:07:59.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78162024-11-22T04:07:59.325ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78172024-11-22T04:07:59.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78182024-11-22T04:07:59.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78192024-11-22T04:07:59.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78202024-11-22T04:07:59.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78212024-11-22T04:07:59.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78222024-11-22T04:07:59.339ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 901.465145ms iteration = 27 status = {}
78232024-11-22T04:08:00.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ebbed31f-f3be-4c49-9e95-1b4b41c1ae44 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78242024-11-22T04:08:00.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ebbed31f-f3be-4c49-9e95-1b4b41c1ae44 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78252024-11-22T04:08:00.260ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2279 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ebbed31f-f3be-4c49-9e95-1b4b41c1ae44 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78262024-11-22T04:08:00.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 650 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 82b8ea5f-f291-4f41-b606-56dd5ec0cdfd response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
78272024-11-22T04:08:01.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5d6b4f8e-09a5-42bc-a4a6-f30232d42ded roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78282024-11-22T04:08:01.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5d6b4f8e-09a5-42bc-a4a6-f30232d42ded resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78292024-11-22T04:08:01.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2418 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5d6b4f8e-09a5-42bc-a4a6-f30232d42ded response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78302024-11-22T04:08:02.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b560d3a-e09f-4d92-99cc-47de74443566 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78312024-11-22T04:08:02.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b560d3a-e09f-4d92-99cc-47de74443566 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78322024-11-22T04:08:02.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2751 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1b560d3a-e09f-4d92-99cc-47de74443566 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78332024-11-22T04:08:03.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 683ba086-cdb5-49e8-9124-dc2794b86c51 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78342024-11-22T04:08:03.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 683ba086-cdb5-49e8-9124-dc2794b86c51 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78352024-11-22T04:08:03.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 683ba086-cdb5-49e8-9124-dc2794b86c51 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78362024-11-22T04:08:04.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd6e0015-f584-443f-9d61-82a70c0a52e7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78372024-11-22T04:08:04.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd6e0015-f584-443f-9d61-82a70c0a52e7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78382024-11-22T04:08:04.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2807 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd6e0015-f584-443f-9d61-82a70c0a52e7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78392024-11-22T04:08:05.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ea72eedd-3198-47ea-9ff3-df5cac9638af roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78402024-11-22T04:08:05.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ea72eedd-3198-47ea-9ff3-df5cac9638af resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78412024-11-22T04:08:05.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2258 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ea72eedd-3198-47ea-9ff3-df5cac9638af response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78422024-11-22T04:08:06.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5bffe5da-da06-440b-a5e3-af249f9c0045 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78432024-11-22T04:08:06.386ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5bffe5da-da06-440b-a5e3-af249f9c0045 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78442024-11-22T04:08:06.387ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5bffe5da-da06-440b-a5e3-af249f9c0045 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78452024-11-22T04:08:07.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 544526f4-db45-462e-a0a6-b033f9dafb64 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78462024-11-22T04:08:07.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 544526f4-db45-462e-a0a6-b033f9dafb64 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78472024-11-22T04:08:07.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2074 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 544526f4-db45-462e-a0a6-b033f9dafb64 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78482024-11-22T04:08:08.428ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f6b38ab-90bd-4fa0-acd9-2163183849a5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78492024-11-22T04:08:08.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f6b38ab-90bd-4fa0-acd9-2163183849a5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78502024-11-22T04:08:08.430ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1995 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f6b38ab-90bd-4fa0-acd9-2163183849a5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78512024-11-22T04:08:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
78522024-11-22T04:08:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
78532024-11-22T04:08:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78542024-11-22T04:08:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78552024-11-22T04:08:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78562024-11-22T04:08:08.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78572024-11-22T04:08:08.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78582024-11-22T04:08:08.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78592024-11-22T04:08:08.467ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78602024-11-22T04:08:08.469ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78612024-11-22T04:08:08.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78622024-11-22T04:08:08.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78632024-11-22T04:08:08.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.471068ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78642024-11-22T04:08:08.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78652024-11-22T04:08:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78662024-11-22T04:08:08.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78672024-11-22T04:08:08.475ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
78682024-11-22T04:08:08.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78692024-11-22T04:08:08.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78702024-11-22T04:08:08.487ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
78712024-11-22T04:08:08.487ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.314247ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
78722024-11-22T04:08:09.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3dbbbe2c-0880-42f3-8a0d-cf0a518a26bb roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78732024-11-22T04:08:09.452ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3dbbbe2c-0880-42f3-8a0d-cf0a518a26bb resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78742024-11-22T04:08:09.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3dbbbe2c-0880-42f3-8a0d-cf0a518a26bb response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78752024-11-22T04:08:10.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 829d0367-67db-4498-8a39-cc4da7eefc54 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78762024-11-22T04:08:10.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 829d0367-67db-4498-8a39-cc4da7eefc54 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78772024-11-22T04:08:10.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2049 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 829d0367-67db-4498-8a39-cc4da7eefc54 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78782024-11-22T04:08:10.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 541 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = ceaa4189-7e0b-4f74-8427-fdfcc071aa73 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
78792024-11-22T04:08:11.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4948fa9f-02b9-4732-a17c-a02790507523 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78802024-11-22T04:08:11.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4948fa9f-02b9-4732-a17c-a02790507523 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78812024-11-22T04:08:11.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2235 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4948fa9f-02b9-4732-a17c-a02790507523 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78822024-11-22T04:08:12.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a7b45efd-706a-4748-8e76-a0cc2b6660fa roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78832024-11-22T04:08:12.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a7b45efd-706a-4748-8e76-a0cc2b6660fa resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78842024-11-22T04:08:12.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2701 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a7b45efd-706a-4748-8e76-a0cc2b6660fa response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78852024-11-22T04:08:13.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 28847c3b-12a5-4a4c-b97d-195b06ae2e8a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78862024-11-22T04:08:13.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 28847c3b-12a5-4a4c-b97d-195b06ae2e8a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78872024-11-22T04:08:13.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5352 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 28847c3b-12a5-4a4c-b97d-195b06ae2e8a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78882024-11-22T04:08:14.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 783df60c-b09d-45d8-b631-162b63da8a06 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78892024-11-22T04:08:14.560ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 783df60c-b09d-45d8-b631-162b63da8a06 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78902024-11-22T04:08:14.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2044 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 783df60c-b09d-45d8-b631-162b63da8a06 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78912024-11-22T04:08:15.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24040b49-e61f-4f1a-81c3-86c3b874a4c5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78922024-11-22T04:08:15.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24040b49-e61f-4f1a-81c3-86c3b874a4c5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78932024-11-22T04:08:15.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2671 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 24040b49-e61f-4f1a-81c3-86c3b874a4c5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78942024-11-22T04:08:16.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c9bbd60e-54f7-409c-b790-c536d9a3d55b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78952024-11-22T04:08:16.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c9bbd60e-54f7-409c-b790-c536d9a3d55b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78962024-11-22T04:08:16.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2302 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c9bbd60e-54f7-409c-b790-c536d9a3d55b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78972024-11-22T04:08:17.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f35e4c38-6d6a-4719-bfc1-5db881e40712 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78982024-11-22T04:08:17.623ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f35e4c38-6d6a-4719-bfc1-5db881e40712 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
78992024-11-22T04:08:17.625ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2566 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f35e4c38-6d6a-4719-bfc1-5db881e40712 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79002024-11-22T04:08:18.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
79012024-11-22T04:08:18.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
79022024-11-22T04:08:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79032024-11-22T04:08:18.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79042024-11-22T04:08:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79052024-11-22T04:08:18.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79062024-11-22T04:08:18.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79072024-11-22T04:08:18.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79082024-11-22T04:08:18.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79092024-11-22T04:08:18.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.169654ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
79102024-11-22T04:08:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79112024-11-22T04:08:18.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79122024-11-22T04:08:18.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79132024-11-22T04:08:18.444ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79142024-11-22T04:08:18.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79152024-11-22T04:08:18.446ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79162024-11-22T04:08:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
79172024-11-22T04:08:18.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79182024-11-22T04:08:18.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79192024-11-22T04:08:18.458ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
79202024-11-22T04:08:18.458ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.438345ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
79212024-11-22T04:08:18.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6eaa5e07-fb87-44a8-8e81-7e4441c668c1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79222024-11-22T04:08:18.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6eaa5e07-fb87-44a8-8e81-7e4441c668c1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79232024-11-22T04:08:18.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1894 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6eaa5e07-fb87-44a8-8e81-7e4441c668c1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79242024-11-22T04:08:19.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 87fe5c7c-4469-422b-b468-89f1e3585aa4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79252024-11-22T04:08:19.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 87fe5c7c-4469-422b-b468-89f1e3585aa4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79262024-11-22T04:08:19.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1881 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 87fe5c7c-4469-422b-b468-89f1e3585aa4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79272024-11-22T04:08:20.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 832 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 11719b9a-096c-4014-b55f-c9cff6f77154 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
79282024-11-22T04:08:20.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ae0afd0-5d2d-4a57-be3c-91cfe7284dc4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79292024-11-22T04:08:20.686ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ae0afd0-5d2d-4a57-be3c-91cfe7284dc4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79302024-11-22T04:08:20.688ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2432 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ae0afd0-5d2d-4a57-be3c-91cfe7284dc4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79312024-11-22T04:08:21.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4408c7ed-e289-4fd0-924d-510db73176ad roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79322024-11-22T04:08:21.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4408c7ed-e289-4fd0-924d-510db73176ad resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79332024-11-22T04:08:21.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2259 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4408c7ed-e289-4fd0-924d-510db73176ad response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79342024-11-22T04:08:22.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2129c85a-57bf-4c78-a55f-af742a346241 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79352024-11-22T04:08:22.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2129c85a-57bf-4c78-a55f-af742a346241 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79362024-11-22T04:08:22.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2129c85a-57bf-4c78-a55f-af742a346241 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79372024-11-22T04:08:23.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 42802e30-3a17-4fa1-82d5-ceffd6160476 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79382024-11-22T04:08:23.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 42802e30-3a17-4fa1-82d5-ceffd6160476 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79392024-11-22T04:08:23.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2469 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 42802e30-3a17-4fa1-82d5-ceffd6160476 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79402024-11-22T04:08:24.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27c34a68-3b50-4d94-8b26-5eb41168bbfc roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79412024-11-22T04:08:24.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27c34a68-3b50-4d94-8b26-5eb41168bbfc resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79422024-11-22T04:08:24.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2163 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27c34a68-3b50-4d94-8b26-5eb41168bbfc response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79432024-11-22T04:08:25.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 3c7cfa12-b53c-4523-bb70-846b4dc4a914 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
79442024-11-22T04:08:25.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 3c7cfa12-b53c-4523-bb70-846b4dc4a914 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
79452024-11-22T04:08:25.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2991 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 3c7cfa12-b53c-4523-bb70-846b4dc4a914 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
79462024-11-22T04:08:25.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 18ca5bfb-aa26-4558-8118-7ce94fa2ba2a roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
79472024-11-22T04:08:25.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 18ca5bfb-aa26-4558-8118-7ce94fa2ba2a resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
79482024-11-22T04:08:25.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2833 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 18ca5bfb-aa26-4558-8118-7ce94fa2ba2a response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
79492024-11-22T04:08:25.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f367d013-0d2f-48fc-bb43-3a90a79de0e4 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
79502024-11-22T04:08:25.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f367d013-0d2f-48fc-bb43-3a90a79de0e4 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
79512024-11-22T04:08:25.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2934 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = f367d013-0d2f-48fc-bb43-3a90a79de0e4 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
79522024-11-22T04:08:25.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 756b968c-d974-4d86-8f1d-ebc81ddc75c6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79532024-11-22T04:08:25.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 756b968c-d974-4d86-8f1d-ebc81ddc75c6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79542024-11-22T04:08:25.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 756b968c-d974-4d86-8f1d-ebc81ddc75c6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79552024-11-22T04:08:26.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ac320f29-bb6f-4d7e-950e-8d63e4366ca4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79562024-11-22T04:08:26.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ac320f29-bb6f-4d7e-950e-8d63e4366ca4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79572024-11-22T04:08:26.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1914 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ac320f29-bb6f-4d7e-950e-8d63e4366ca4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79582024-11-22T04:08:27.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aca560c0-f1eb-46d7-b78c-c1b7c442d5e7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79592024-11-22T04:08:27.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aca560c0-f1eb-46d7-b78c-c1b7c442d5e7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79602024-11-22T04:08:27.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2591 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = aca560c0-f1eb-46d7-b78c-c1b7c442d5e7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
79612024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
79622024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
79632024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79642024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79652024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
79662024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
79672024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79682024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79692024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
79702024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79712024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79722024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
79732024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79742024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
79752024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
79762024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
79772024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79782024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
79792024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
79802024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
79812024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79822024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
79832024-11-22T04:08:28.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
79842024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79852024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
79862024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79872024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
79882024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79892024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79902024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
79912024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
79922024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
79932024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79942024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
79952024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79962024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79972024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79982024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79992024-11-22T04:08:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
80002024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80012024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
80022024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80032024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80042024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80052024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80062024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80072024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80082024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
80092024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80102024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80112024-11-22T04:08:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80122024-11-22T04:08:28.440ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80132024-11-22T04:08:28.441ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.205917ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
80142024-11-22T04:08:28.442ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
80152024-11-22T04:08:28.442ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80162024-11-22T04:08:28.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1737, tv_nsec: 793800428 } })
80172024-11-22T04:08:28.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80182024-11-22T04:08:28.443ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
80192024-11-22T04:08:28.443ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1737, tv_nsec: 794718584 } })
80202024-11-22T04:08:28.444ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
80212024-11-22T04:08:28.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80222024-11-22T04:08:28.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80232024-11-22T04:08:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80242024-11-22T04:08:28.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80252024-11-22T04:08:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80262024-11-22T04:08:28.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80272024-11-22T04:08:28.447ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80282024-11-22T04:08:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80292024-11-22T04:08:28.449ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.612958ms iteration = 28 status = {"errors":[],"records_set_to_done":[]}
80302024-11-22T04:08:28.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80312024-11-22T04:08:28.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80322024-11-22T04:08:28.451ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1737, tv_nsec: 802508053 } })
80332024-11-22T04:08:28.451ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
80342024-11-22T04:08:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
80352024-11-22T04:08:28.452ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80362024-11-22T04:08:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
80372024-11-22T04:08:28.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80382024-11-22T04:08:28.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80392024-11-22T04:08:28.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80402024-11-22T04:08:28.456ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80412024-11-22T04:08:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80422024-11-22T04:08:28.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80432024-11-22T04:08:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80442024-11-22T04:08:28.461ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80452024-11-22T04:08:28.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80462024-11-22T04:08:28.475ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80472024-11-22T04:08:28.475ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
80482024-11-22T04:08:28.475ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80492024-11-22T04:08:28.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80502024-11-22T04:08:28.481ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80512024-11-22T04:08:28.482ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80522024-11-22T04:08:28.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80532024-11-22T04:08:28.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
80542024-11-22T04:08:28.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80552024-11-22T04:08:28.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80562024-11-22T04:08:28.485ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
80572024-11-22T04:08:28.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
80582024-11-22T04:08:28.489ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80592024-11-22T04:08:28.489ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80602024-11-22T04:08:28.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80612024-11-22T04:08:28.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80622024-11-22T04:08:28.492ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.06014ms iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
80632024-11-22T04:08:28.495ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80642024-11-22T04:08:28.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
80652024-11-22T04:08:28.497ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80662024-11-22T04:08:28.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80672024-11-22T04:08:28.497ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80682024-11-22T04:08:28.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80692024-11-22T04:08:28.501ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80702024-11-22T04:08:28.501ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.637551ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80712024-11-22T04:08:28.505ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80722024-11-22T04:08:28.505ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80732024-11-22T04:08:28.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
80742024-11-22T04:08:28.507ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80752024-11-22T04:08:28.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
80762024-11-22T04:08:28.509ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
80772024-11-22T04:08:28.509ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80782024-11-22T04:08:28.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80792024-11-22T04:08:28.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80802024-11-22T04:08:28.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80812024-11-22T04:08:28.517ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80822024-11-22T04:08:28.517ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80832024-11-22T04:08:28.518ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80842024-11-22T04:08:28.521ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
80852024-11-22T04:08:28.521ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 83.132055ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
80862024-11-22T04:08:28.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
80872024-11-22T04:08:28.523ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80882024-11-22T04:08:28.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80892024-11-22T04:08:28.525ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.130936ms iteration = 28 status = 0
80902024-11-22T04:08:28.527ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.329965ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80912024-11-22T04:08:28.528ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80922024-11-22T04:08:28.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80932024-11-22T04:08:28.529ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.268399ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80942024-11-22T04:08:28.530ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80952024-11-22T04:08:28.530ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80962024-11-22T04:08:28.530ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80972024-11-22T04:08:28.530ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80982024-11-22T04:08:28.539ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 100.848879ms iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
80992024-11-22T04:08:28.560ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 122.627716ms iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
81002024-11-22T04:08:28.563ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81012024-11-22T04:08:28.563ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
81022024-11-22T04:08:28.563ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 124.842515ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
81032024-11-22T04:08:28.563ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
81042024-11-22T04:08:28.563ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81052024-11-22T04:08:28.563ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32339824-3a83-49d2-ad18-7bdd41fc29cc", "content-length": "26", "date": "Fri, 22 Nov 2024 04:08:28 GMT"} })
81062024-11-22T04:08:28.563ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81072024-11-22T04:08:28.564ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
81082024-11-22T04:08:28.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81092024-11-22T04:08:28.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81102024-11-22T04:08:28.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81112024-11-22T04:08:28.586ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81122024-11-22T04:08:28.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81132024-11-22T04:08:28.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81142024-11-22T04:08:28.587ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81152024-11-22T04:08:28.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
81162024-11-22T04:08:28.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81172024-11-22T04:08:28.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81182024-11-22T04:08:28.597ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.321517ms iteration = 31 status = {"physical_disks_added":0}
81192024-11-22T04:08:28.709ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
81202024-11-22T04:08:28.709ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81212024-11-22T04:08:28.710ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b318fb76-48ee-441d-8b5b-3f411730e5bf", "content-length": "26", "date": "Fri, 22 Nov 2024 04:08:28 GMT"} })
81222024-11-22T04:08:28.710ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81232024-11-22T04:08:28.712ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81242024-11-22T04:08:28.712ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
81252024-11-22T04:08:28.712ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
81262024-11-22T04:08:28.713ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98101062-430b-4849-9808-bd44297fb1e7", "content-length": "26", "date": "Fri, 22 Nov 2024 04:08:28 GMT"} })
81272024-11-22T04:08:28.713ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
81282024-11-22T04:08:28.715ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
81292024-11-22T04:08:28.792ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81302024-11-22T04:08:28.793ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad41a259-e637-4843-b3f4-34c35728e873", "content-length": "691", "date": "Fri, 22 Nov 2024 04:08:28 GMT"} })
81312024-11-22T04:08:28.793ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
81322024-11-22T04:08:28.793ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
81332024-11-22T04:08:28.793ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
81342024-11-22T04:08:28.794ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 355.816133ms iteration = 29 status = {}
81352024-11-22T04:08:28.800ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
81362024-11-22T04:08:28.800ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81372024-11-22T04:08:28.801ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3bcee746-2f76-4454-827e-a35823e1d892", "content-length": "372", "date": "Fri, 22 Nov 2024 04:08:28 GMT"} })
81382024-11-22T04:08:28.801ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81392024-11-22T04:08:28.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81402024-11-22T04:08:28.814ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
81412024-11-22T04:08:28.814ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
81422024-11-22T04:08:28.815ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c01691e7-e1ed-4d51-a563-1c8215b85f11", "date": "Fri, 22 Nov 2024 04:08:28 GMT"} })
81432024-11-22T04:08:28.815ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81442024-11-22T04:08:28.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81452024-11-22T04:08:28.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81462024-11-22T04:08:28.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81472024-11-22T04:08:28.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81482024-11-22T04:08:28.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81492024-11-22T04:08:28.827ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
81502024-11-22T04:08:28.827ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
81512024-11-22T04:08:28.828ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "06212554-9a3b-480b-88c5-17fe0f8c812e", "date": "Fri, 22 Nov 2024 04:08:28 GMT"} })
81522024-11-22T04:08:28.829ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 391.18754ms iteration = 29 status = {}
81532024-11-22T04:08:28.856ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86ef6f2d-f0b9-4e71-b4db-36d85eeb3c6d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
81542024-11-22T04:08:28.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86ef6f2d-f0b9-4e71-b4db-36d85eeb3c6d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
81552024-11-22T04:08:28.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2132 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86ef6f2d-f0b9-4e71-b4db-36d85eeb3c6d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
81562024-11-22T04:08:28.925ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
81572024-11-22T04:08:28.925ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "68fb7827-db92-4e45-8b93-de640f6585cb", "content-length": "2", "date": "Fri, 22 Nov 2024 04:08:27 GMT"} })
81582024-11-22T04:08:28.927ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81592024-11-22T04:08:28.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81602024-11-22T04:08:28.927ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81612024-11-22T04:08:28.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81622024-11-22T04:08:28.929ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 490.826339ms iteration = 28 status = null
81632024-11-22T04:08:28.930ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
81642024-11-22T04:08:28.930ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81652024-11-22T04:08:28.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81662024-11-22T04:08:28.932ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 494.546764ms iteration = 28 status = {}
81672024-11-22T04:08:28.940ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
81682024-11-22T04:08:28.940ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a81ef52-3acb-4505-9d19-a7554bc2f8fe", "content-length": "134", "date": "Fri, 22 Nov 2024 04:08:27 GMT"} })
81692024-11-22T04:08:28.940ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
81702024-11-22T04:08:28.940ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
81712024-11-22T04:08:28.940ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
81722024-11-22T04:08:28.940ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
81732024-11-22T04:08:28.940ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81742024-11-22T04:08:28.940ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81752024-11-22T04:08:28.940ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81762024-11-22T04:08:28.940ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81772024-11-22T04:08:28.941ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
81782024-11-22T04:08:28.941ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
81792024-11-22T04:08:28.941ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
81802024-11-22T04:08:28.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81812024-11-22T04:08:28.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81822024-11-22T04:08:28.943ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
81832024-11-22T04:08:28.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "394e4f97-7aa3-4bed-882a-996a0369b5f1", "content-length": "2", "date": "Fri, 22 Nov 2024 04:08:27 GMT"} })
81842024-11-22T04:08:28.943ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81852024-11-22T04:08:28.943ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "78f99761-4e19-4234-bb39-2153f182aaa0", "content-length": "52", "date": "Fri, 22 Nov 2024 04:08:27 GMT"} })
81862024-11-22T04:08:28.943ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
81872024-11-22T04:08:28.943ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81882024-11-22T04:08:29.037ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c13704c0-6fd3-40da-ade4-e6aa2b3cff05", "date": "Fri, 22 Nov 2024 04:08:28 GMT"} })
81892024-11-22T04:08:29.037ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
81902024-11-22T04:08:29.037ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81912024-11-22T04:08:29.038ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6a24724-e434-4cd9-8a68-fd7c12782cce", "content-length": "682", "date": "Fri, 22 Nov 2024 04:08:29 GMT"} })
81922024-11-22T04:08:29.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81932024-11-22T04:08:29.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81942024-11-22T04:08:29.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81952024-11-22T04:08:29.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81962024-11-22T04:08:29.046ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81972024-11-22T04:08:29.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81982024-11-22T04:08:29.048ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81992024-11-22T04:08:29.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82002024-11-22T04:08:29.055ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 617.412715ms iteration = 28 status = {}
82012024-11-22T04:08:29.333ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
82022024-11-22T04:08:29.333ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
82032024-11-22T04:08:29.363ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
82042024-11-22T04:08:29.363ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:64181
82052024-11-22T04:08:29.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64181 req_id = bfaa9f86-f2d6-4bf6-b912-710d675d7115 roles = RoleSet { roles: {} } uri = /metrics/producers
82062024-11-22T04:08:29.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64181 req_id = bfaa9f86-f2d6-4bf6-b912-710d675d7115 resource = Database result = Ok(()) uri = /metrics/producers
82072024-11-22T04:08:29.403ZINFOnexus: assigned collector to new producer collector_id = 619dee3a-9d47-45ec-a665-d347c721dbd7 file = nexus/src/app/oximeter.rs:76 producer_id = 8af2b85f-6ab3-4781-9033-075825f48255
82082024-11-22T04:08:29.403ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39672 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:64181 req_id = bfaa9f86-f2d6-4bf6-b912-710d675d7115 response_code = 201 uri = /metrics/producers
82092024-11-22T04:08:29.403ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "bfaa9f86-f2d6-4bf6-b912-710d675d7115", "content-length": "41", "date": "Fri, 22 Nov 2024 04:08:29 GMT"} })
82102024-11-22T04:08:29.406ZDEBGnexus (producer-registration-task): registered with nexus successfully
82112024-11-22T04:08:29.406ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
82122024-11-22T04:08:29.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f55656fb-b65a-4cac-b877-db45e5b79887 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82132024-11-22T04:08:29.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f55656fb-b65a-4cac-b877-db45e5b79887 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82142024-11-22T04:08:29.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2169 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f55656fb-b65a-4cac-b877-db45e5b79887 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82152024-11-22T04:08:30.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 535 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = ece2dcd7-9dd6-4fbb-9feb-1a40f80bea87 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
82162024-11-22T04:08:30.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff2117b8-e8d1-4f05-9ba3-e13cd5feebd5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82172024-11-22T04:08:30.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff2117b8-e8d1-4f05-9ba3-e13cd5feebd5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82182024-11-22T04:08:30.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2605 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff2117b8-e8d1-4f05-9ba3-e13cd5feebd5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82192024-11-22T04:08:31.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ad564ae0-18e4-42ec-801d-fe08efd8f1e0 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82202024-11-22T04:08:31.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ad564ae0-18e4-42ec-801d-fe08efd8f1e0 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82212024-11-22T04:08:31.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2487 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ad564ae0-18e4-42ec-801d-fe08efd8f1e0 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82222024-11-22T04:08:32.940ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7244d536-c640-413b-beb3-1e7dcdb11c5d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82232024-11-22T04:08:32.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7244d536-c640-413b-beb3-1e7dcdb11c5d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82242024-11-22T04:08:32.942ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2286 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7244d536-c640-413b-beb3-1e7dcdb11c5d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82252024-11-22T04:08:33.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a80de9bd-a2fd-4bb0-90d3-3c23212c83ea roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82262024-11-22T04:08:33.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a80de9bd-a2fd-4bb0-90d3-3c23212c83ea resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82272024-11-22T04:08:33.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2359 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a80de9bd-a2fd-4bb0-90d3-3c23212c83ea response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82282024-11-22T04:08:34.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 22612002-fd1f-407b-bc6b-416d4a7eb4f3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82292024-11-22T04:08:34.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 22612002-fd1f-407b-bc6b-416d4a7eb4f3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82302024-11-22T04:08:34.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 22612002-fd1f-407b-bc6b-416d4a7eb4f3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82312024-11-22T04:08:36.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db0e1dcf-fec5-406f-98b8-c0b6ad0d606d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82322024-11-22T04:08:36.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db0e1dcf-fec5-406f-98b8-c0b6ad0d606d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82332024-11-22T04:08:36.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2288 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db0e1dcf-fec5-406f-98b8-c0b6ad0d606d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82342024-11-22T04:08:37.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f2e7aac9-79af-4475-938b-d1ad6cb9cf5d roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82352024-11-22T04:08:37.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f2e7aac9-79af-4475-938b-d1ad6cb9cf5d resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82362024-11-22T04:08:37.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2203 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f2e7aac9-79af-4475-938b-d1ad6cb9cf5d response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82372024-11-22T04:08:38.047ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 949823c0-6ab5-4e6b-95c0-1f2cffc08c5a roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82382024-11-22T04:08:38.047ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 949823c0-6ab5-4e6b-95c0-1f2cffc08c5a resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82392024-11-22T04:08:38.049ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2096 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 949823c0-6ab5-4e6b-95c0-1f2cffc08c5a response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82402024-11-22T04:08:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
82412024-11-22T04:08:38.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82422024-11-22T04:08:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
82432024-11-22T04:08:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82442024-11-22T04:08:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82452024-11-22T04:08:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82462024-11-22T04:08:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82472024-11-22T04:08:38.441ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82482024-11-22T04:08:38.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82492024-11-22T04:08:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82502024-11-22T04:08:38.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82512024-11-22T04:08:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82522024-11-22T04:08:38.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82532024-11-22T04:08:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82542024-11-22T04:08:38.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82552024-11-22T04:08:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
82562024-11-22T04:08:38.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82572024-11-22T04:08:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82582024-11-22T04:08:38.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
82592024-11-22T04:08:38.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.633271ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
82602024-11-22T04:08:38.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.406045ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
82612024-11-22T04:08:39.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff61c3b3-87ca-441f-90d1-ba88d40400be roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82622024-11-22T04:08:39.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff61c3b3-87ca-441f-90d1-ba88d40400be resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82632024-11-22T04:08:39.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2085 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ff61c3b3-87ca-441f-90d1-ba88d40400be response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82642024-11-22T04:08:40.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b21625f6-5440-4895-819e-34f99aeba34c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82652024-11-22T04:08:40.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b21625f6-5440-4895-819e-34f99aeba34c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82662024-11-22T04:08:40.092ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2121 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b21625f6-5440-4895-819e-34f99aeba34c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82672024-11-22T04:08:40.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 623 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 1446dc5b-6e93-4910-aced-5f144ab657d8 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
82682024-11-22T04:08:41.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f02883ad-1f29-43ee-abc0-ef8dc129f876 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82692024-11-22T04:08:41.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f02883ad-1f29-43ee-abc0-ef8dc129f876 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82702024-11-22T04:08:41.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2342 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f02883ad-1f29-43ee-abc0-ef8dc129f876 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82712024-11-22T04:08:42.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1ea6e676-cc0e-48b2-bf5d-9447f19aa24f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82722024-11-22T04:08:42.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1ea6e676-cc0e-48b2-bf5d-9447f19aa24f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82732024-11-22T04:08:42.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1742 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1ea6e676-cc0e-48b2-bf5d-9447f19aa24f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82742024-11-22T04:08:43.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 22ddb469-8641-4a2f-9b57-a78b584c8317 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82752024-11-22T04:08:43.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 22ddb469-8641-4a2f-9b57-a78b584c8317 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82762024-11-22T04:08:43.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 22ddb469-8641-4a2f-9b57-a78b584c8317 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82772024-11-22T04:08:44.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 58990c18-09d6-4904-aff8-ec4dfd3b7d92 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82782024-11-22T04:08:44.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 58990c18-09d6-4904-aff8-ec4dfd3b7d92 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82792024-11-22T04:08:44.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2696 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 58990c18-09d6-4904-aff8-ec4dfd3b7d92 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82802024-11-22T04:08:45.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d3243fb3-1fb1-40c1-8b19-acd9a992c940 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82812024-11-22T04:08:45.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d3243fb3-1fb1-40c1-8b19-acd9a992c940 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82822024-11-22T04:08:45.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2338 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d3243fb3-1fb1-40c1-8b19-acd9a992c940 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82832024-11-22T04:08:46.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2683ff48-e228-4d03-b1ca-b0410f9055a7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82842024-11-22T04:08:46.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2683ff48-e228-4d03-b1ca-b0410f9055a7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82852024-11-22T04:08:46.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2262 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2683ff48-e228-4d03-b1ca-b0410f9055a7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82862024-11-22T04:08:47.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a4aca13-7954-4866-8be9-ffe9a9840edd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82872024-11-22T04:08:47.240ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a4aca13-7954-4866-8be9-ffe9a9840edd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82882024-11-22T04:08:47.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1982 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2a4aca13-7954-4866-8be9-ffe9a9840edd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82892024-11-22T04:08:48.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 28165eb7-e8bb-4c7e-8d52-e28508bd31ba roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82902024-11-22T04:08:48.262ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 28165eb7-e8bb-4c7e-8d52-e28508bd31ba resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82912024-11-22T04:08:48.264ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 28165eb7-e8bb-4c7e-8d52-e28508bd31ba response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
82922024-11-22T04:08:48.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
82932024-11-22T04:08:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82942024-11-22T04:08:48.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
82952024-11-22T04:08:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82962024-11-22T04:08:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82972024-11-22T04:08:48.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82982024-11-22T04:08:48.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82992024-11-22T04:08:48.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83002024-11-22T04:08:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83012024-11-22T04:08:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83022024-11-22T04:08:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83032024-11-22T04:08:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83042024-11-22T04:08:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83052024-11-22T04:08:48.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83062024-11-22T04:08:48.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83072024-11-22T04:08:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
83082024-11-22T04:08:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83092024-11-22T04:08:48.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83102024-11-22T04:08:48.459ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
83112024-11-22T04:08:48.459ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.163325ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
83122024-11-22T04:08:48.468ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.977392ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83132024-11-22T04:08:49.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ea61b5db-54d4-45eb-bb37-874604cab916 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83142024-11-22T04:08:49.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ea61b5db-54d4-45eb-bb37-874604cab916 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83152024-11-22T04:08:49.283ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ea61b5db-54d4-45eb-bb37-874604cab916 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83162024-11-22T04:08:50.302ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c248eed0-bb24-4905-94b0-94c022e4cd42 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83172024-11-22T04:08:50.302ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c248eed0-bb24-4905-94b0-94c022e4cd42 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83182024-11-22T04:08:50.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2306 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c248eed0-bb24-4905-94b0-94c022e4cd42 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83192024-11-22T04:08:50.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 848 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 00d6a403-7e51-4896-9861-fcea323ccbfc response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
83202024-11-22T04:08:51.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6e5befa-055c-4ad0-afe0-1d407600b4c0 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83212024-11-22T04:08:51.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6e5befa-055c-4ad0-afe0-1d407600b4c0 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83222024-11-22T04:08:51.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2467 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6e5befa-055c-4ad0-afe0-1d407600b4c0 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83232024-11-22T04:08:52.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b8332ff1-78b6-427f-b7aa-ea16b9bf252e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83242024-11-22T04:08:52.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b8332ff1-78b6-427f-b7aa-ea16b9bf252e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83252024-11-22T04:08:52.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2222 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b8332ff1-78b6-427f-b7aa-ea16b9bf252e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83262024-11-22T04:08:53.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95d2b5a4-7615-4d50-8a90-e22ae2730821 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83272024-11-22T04:08:53.366ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95d2b5a4-7615-4d50-8a90-e22ae2730821 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83282024-11-22T04:08:53.368ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2257 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 95d2b5a4-7615-4d50-8a90-e22ae2730821 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83292024-11-22T04:08:54.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d2651907-059f-4080-b2e5-0c7ff38c6978 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83302024-11-22T04:08:54.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d2651907-059f-4080-b2e5-0c7ff38c6978 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83312024-11-22T04:08:54.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d2651907-059f-4080-b2e5-0c7ff38c6978 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83322024-11-22T04:08:55.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0a57aed8-4f90-450b-8d3e-80250d4d978c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83332024-11-22T04:08:55.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0a57aed8-4f90-450b-8d3e-80250d4d978c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83342024-11-22T04:08:55.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2377 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0a57aed8-4f90-450b-8d3e-80250d4d978c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83352024-11-22T04:08:55.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = efabf511-49a1-4aef-b0a1-84bdb3b470e8 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
83362024-11-22T04:08:55.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = efabf511-49a1-4aef-b0a1-84bdb3b470e8 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
83372024-11-22T04:08:55.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3284 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = efabf511-49a1-4aef-b0a1-84bdb3b470e8 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
83382024-11-22T04:08:55.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = d4388748-fadf-457a-8bd4-4c467caa2c61 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
83392024-11-22T04:08:55.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = d4388748-fadf-457a-8bd4-4c467caa2c61 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
83402024-11-22T04:08:55.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2242 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = d4388748-fadf-457a-8bd4-4c467caa2c61 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
83412024-11-22T04:08:55.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 381e06e4-a440-49df-ad12-dce1904f77bd roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
83422024-11-22T04:08:55.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 381e06e4-a440-49df-ad12-dce1904f77bd resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
83432024-11-22T04:08:55.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3747 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 381e06e4-a440-49df-ad12-dce1904f77bd response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
83442024-11-22T04:08:56.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ee329e0-652a-47a8-b62d-d6874ad01d6b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83452024-11-22T04:08:56.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ee329e0-652a-47a8-b62d-d6874ad01d6b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83462024-11-22T04:08:56.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2230 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0ee329e0-652a-47a8-b62d-d6874ad01d6b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83472024-11-22T04:08:57.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 810664e4-b821-4a4d-8e4b-5f0896e5af69 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83482024-11-22T04:08:57.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 810664e4-b821-4a4d-8e4b-5f0896e5af69 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83492024-11-22T04:08:57.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2170 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 810664e4-b821-4a4d-8e4b-5f0896e5af69 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
83502024-11-22T04:08:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
83512024-11-22T04:08:58.437ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
83522024-11-22T04:08:58.437ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
83532024-11-22T04:08:58.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83542024-11-22T04:08:58.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83552024-11-22T04:08:58.437ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("0a6d4402-4330-4dac-a6fc-1163b7dedc8a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6f3e43a0-44c3-470b-aeed-59e4d3e6b91a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d2bf14c6-9ae0-4e6c-817f-248aabab435c.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 788510874 } })
83562024-11-22T04:08:58.437ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
83572024-11-22T04:08:58.437ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
83582024-11-22T04:08:58.437ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
83592024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
83602024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83612024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
83622024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
83632024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
83642024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83652024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
83662024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
83672024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83682024-11-22T04:08:58.438ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
83692024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83702024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
83712024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
83722024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83732024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83742024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
83752024-11-22T04:08:58.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
83762024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83772024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
83782024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
83792024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
83802024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
83812024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83822024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
83832024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
83842024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83852024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
83862024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
83872024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
83882024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
83892024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
83902024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
83912024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
83922024-11-22T04:08:58.438ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea
83932024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
83942024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
83952024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.62\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea"}
83962024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
83972024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83982024-11-22T04:08:58.438ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-22 03:58:58.438262883 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
83992024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
84002024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
84012024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84022024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
84032024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84042024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
84052024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84062024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84072024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
84082024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
84092024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
84102024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84112024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
84122024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
84132024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84142024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
84152024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84162024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
84172024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.520167ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
84182024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
84192024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84202024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84212024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84222024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84232024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84242024-11-22T04:08:58.438ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bf35fb21-6ab5-4f9e-9cf6-4e6162e8ce1b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("da108ce4-fade-4cd8-8ba2-9af291527495.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 789602934 } })
84252024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84262024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
84272024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84282024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84292024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
84302024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84312024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84322024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
84332024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84342024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84352024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84362024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
84372024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84382024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84392024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
84402024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84412024-11-22T04:08:58.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84422024-11-22T04:08:58.439ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
84432024-11-22T04:08:58.439ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 915.116\u{b5}s iteration = 15 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
84442024-11-22T04:08:58.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 792428044 } })
84452024-11-22T04:08:58.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
84462024-11-22T04:08:58.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84472024-11-22T04:08:58.442ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84482024-11-22T04:08:58.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.606802ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
84492024-11-22T04:08:58.442ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84502024-11-22T04:08:58.443ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84512024-11-22T04:08:58.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84522024-11-22T04:08:58.443ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84532024-11-22T04:08:58.444ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
84542024-11-22T04:08:58.444ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
84552024-11-22T04:08:58.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
84562024-11-22T04:08:58.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84572024-11-22T04:08:58.445ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84582024-11-22T04:08:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84592024-11-22T04:08:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
84602024-11-22T04:08:58.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84612024-11-22T04:08:58.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84622024-11-22T04:08:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
84632024-11-22T04:08:58.447ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
84642024-11-22T04:08:58.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
84652024-11-22T04:08:58.447ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84662024-11-22T04:08:58.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84672024-11-22T04:08:58.448ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.136789ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
84682024-11-22T04:08:58.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84692024-11-22T04:08:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84702024-11-22T04:08:58.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84712024-11-22T04:08:58.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84722024-11-22T04:08:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84732024-11-22T04:08:58.451ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84742024-11-22T04:08:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84752024-11-22T04:08:58.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84762024-11-22T04:08:58.452ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84772024-11-22T04:08:58.452ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84782024-11-22T04:08:58.452ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84792024-11-22T04:08:58.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84802024-11-22T04:08:58.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84812024-11-22T04:08:58.453ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84822024-11-22T04:08:58.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84832024-11-22T04:08:58.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84842024-11-22T04:08:58.454ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84852024-11-22T04:08:58.454ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
84862024-11-22T04:08:58.454ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
84872024-11-22T04:08:58.455ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 805930673 } })
84882024-11-22T04:08:58.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
84892024-11-22T04:08:58.455ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
84902024-11-22T04:08:58.455ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84912024-11-22T04:08:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84922024-11-22T04:08:58.456ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84932024-11-22T04:08:58.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84942024-11-22T04:08:58.456ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-22 03:58:58.438262883 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
84952024-11-22T04:08:58.456ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.392746ms iteration = 15 status = {"expiration":"2024-11-22T03:58:58.438262883Z","pruned":[]}
84962024-11-22T04:08:58.458ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84972024-11-22T04:08:58.458ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84982024-11-22T04:08:58.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84992024-11-22T04:08:58.461ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 23.10917ms iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
85002024-11-22T04:08:58.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85012024-11-22T04:08:58.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85022024-11-22T04:08:58.464ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85032024-11-22T04:08:58.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85042024-11-22T04:08:58.464ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85052024-11-22T04:08:58.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85062024-11-22T04:08:58.465ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1767, tv_nsec: 816520931 } })
85072024-11-22T04:08:58.465ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
85082024-11-22T04:08:58.466ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85092024-11-22T04:08:58.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85102024-11-22T04:08:58.467ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85112024-11-22T04:08:58.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85122024-11-22T04:08:58.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85132024-11-22T04:08:58.472ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85142024-11-22T04:08:58.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85152024-11-22T04:08:58.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6572bf91-6053-4d43-89aa-8c3dc482e592 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
85162024-11-22T04:08:58.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6572bf91-6053-4d43-89aa-8c3dc482e592 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
85172024-11-22T04:08:58.474ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
85182024-11-22T04:08:58.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85192024-11-22T04:08:58.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85202024-11-22T04:08:58.480ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85212024-11-22T04:08:58.485ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
85222024-11-22T04:08:58.485ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85232024-11-22T04:08:58.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85242024-11-22T04:08:58.486ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
85252024-11-22T04:08:58.486ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
85262024-11-22T04:08:58.486ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 48.373709ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
85272024-11-22T04:08:58.486ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85282024-11-22T04:08:58.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85292024-11-22T04:08:58.488ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14421 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 6572bf91-6053-4d43-89aa-8c3dc482e592 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
85302024-11-22T04:08:58.489ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85312024-11-22T04:08:58.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85322024-11-22T04:08:58.492ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85332024-11-22T04:08:58.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85342024-11-22T04:08:58.494ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85352024-11-22T04:08:58.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85362024-11-22T04:08:58.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85372024-11-22T04:08:58.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85382024-11-22T04:08:58.498ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85392024-11-22T04:08:58.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85402024-11-22T04:08:58.499ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.453551ms iteration = 29 status = {"errors":[],"records_set_to_done":[]}
85412024-11-22T04:08:58.501ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85422024-11-22T04:08:58.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85432024-11-22T04:08:58.502ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
85442024-11-22T04:08:58.502ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 64.449694ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
85452024-11-22T04:08:58.503ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85462024-11-22T04:08:58.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85472024-11-22T04:08:58.504ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85482024-11-22T04:08:58.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85492024-11-22T04:08:58.508ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85502024-11-22T04:08:58.509ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
85512024-11-22T04:08:58.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85522024-11-22T04:08:58.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85532024-11-22T04:08:58.509ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85542024-11-22T04:08:58.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85552024-11-22T04:08:58.510ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85562024-11-22T04:08:58.510ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
85572024-11-22T04:08:58.510ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85582024-11-22T04:08:58.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85592024-11-22T04:08:58.513ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85602024-11-22T04:08:58.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85612024-11-22T04:08:58.516ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 78.010735ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
85622024-11-22T04:08:58.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85632024-11-22T04:08:58.519ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85642024-11-22T04:08:58.519ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.247782ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85652024-11-22T04:08:58.520ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85662024-11-22T04:08:58.520ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85672024-11-22T04:08:58.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85682024-11-22T04:08:58.520ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
85692024-11-22T04:08:58.520ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
85702024-11-22T04:08:58.520ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.80086ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
85712024-11-22T04:08:58.523ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85722024-11-22T04:08:58.523ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
85732024-11-22T04:08:58.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
85742024-11-22T04:08:58.524ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85752024-11-22T04:08:58.524ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85762024-11-22T04:08:58.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85772024-11-22T04:08:58.540ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
85782024-11-22T04:08:58.540ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
85792024-11-22T04:08:58.540ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
85802024-11-22T04:08:58.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85812024-11-22T04:08:58.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85822024-11-22T04:08:58.541ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
85832024-11-22T04:08:58.541ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
85842024-11-22T04:08:58.571ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
85852024-11-22T04:08:58.591ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
85862024-11-22T04:08:58.591ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85872024-11-22T04:08:58.591ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c00d804-6eeb-48b5-b50b-3c007d7d64fb", "content-length": "26", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
85882024-11-22T04:08:58.591ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85892024-11-22T04:08:58.593ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
85902024-11-22T04:08:58.606ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85912024-11-22T04:08:58.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
85922024-11-22T04:08:58.624ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85932024-11-22T04:08:58.625ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63acd8c0-c035-415d-abce-5ddb9ca5419e", "content-length": "26", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
85942024-11-22T04:08:58.625ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
85952024-11-22T04:08:58.626ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
85962024-11-22T04:08:58.633ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
85972024-11-22T04:08:58.633ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
85982024-11-22T04:08:58.633ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68cde16c-da5b-4d9f-963f-95c2d68d44df", "content-length": "26", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
85992024-11-22T04:08:58.633ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86002024-11-22T04:08:58.635ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86012024-11-22T04:08:58.690ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86022024-11-22T04:08:58.690ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "01ca0db6-6a40-401d-b405-e67544f2953a", "content-length": "691", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
86032024-11-22T04:08:58.690ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
86042024-11-22T04:08:58.690ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
86052024-11-22T04:08:58.691ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
86062024-11-22T04:08:58.697ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 258.913675ms iteration = 30 status = {}
86072024-11-22T04:08:58.697ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86082024-11-22T04:08:58.701ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
86092024-11-22T04:08:58.701ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86102024-11-22T04:08:58.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86112024-11-22T04:08:58.705ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 267.516627ms iteration = 29 status = 0
86122024-11-22T04:08:58.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 303.16814ms iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86132024-11-22T04:08:58.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 307.67741ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86142024-11-22T04:08:58.746ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
86152024-11-22T04:08:58.746ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
86162024-11-22T04:08:58.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86172024-11-22T04:08:58.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86182024-11-22T04:08:58.748ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86192024-11-22T04:08:58.748ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
86202024-11-22T04:08:58.750ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86212024-11-22T04:08:58.750ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86222024-11-22T04:08:58.750ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 311.764211ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86232024-11-22T04:08:58.750ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
86242024-11-22T04:08:58.750ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
86252024-11-22T04:08:58.750ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 312.728879ms iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86262024-11-22T04:08:58.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
86272024-11-22T04:08:58.753ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86282024-11-22T04:08:58.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86292024-11-22T04:08:58.756ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86302024-11-22T04:08:58.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86312024-11-22T04:08:58.768ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
86322024-11-22T04:08:58.768ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "52a5f491-0338-4ca3-a081-77e2947c0607", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86332024-11-22T04:08:58.768ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86342024-11-22T04:08:58.770ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d1c98ff7-6b84-4d48-93fd-f905507c4f1d", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86352024-11-22T04:08:58.770ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86362024-11-22T04:08:58.771ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
86372024-11-22T04:08:58.771ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 333.771252ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
86382024-11-22T04:08:58.782ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86392024-11-22T04:08:58.783ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "02a21098-594a-438d-95ca-5868dc9d84a4", "content-length": "2", "date": "Fri, 22 Nov 2024 04:08:57 GMT"} })
86402024-11-22T04:08:58.786ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86412024-11-22T04:08:58.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86422024-11-22T04:08:58.789ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 351.67877ms iteration = 29 status = null
86432024-11-22T04:08:58.793ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86442024-11-22T04:08:58.796ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
86452024-11-22T04:08:58.796ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
86462024-11-22T04:08:58.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
86472024-11-22T04:08:58.797ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
86482024-11-22T04:08:58.797ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 0 version = 2
86492024-11-22T04:08:58.797ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86502024-11-22T04:08:58.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86512024-11-22T04:08:58.799ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 6f2d86f2-6de6-4684-83fe-c32622f287de dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
86522024-11-22T04:08:58.799ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
86532024-11-22T04:08:58.799ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-22 03:55:08.212168 UTC dns_group = internal generation = 1
86542024-11-22T04:08:58.799ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 362.287268ms iteration = 15 status = {"generation":1}
86552024-11-22T04:08:58.799ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86562024-11-22T04:08:58.801ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-22T03:54:55.939927Z, time_modified: 2024-11-22T03:54:55.939927Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, db_silo: Silo { identity: SiloIdentity { id: f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-22T03:55:08.938187Z, time_modified: 2024-11-22T03:55:08.938187Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e" }] }) }
86572024-11-22T04:08:58.801ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 363.270255ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]}},"default_endpoint":{"silo_id":"f0a97a2b-64c8-4e4c-8eb7-11a4e1b5b208","tls_certs":["98a9718ede1d4c4d701e8693c2f523af9b1e57362a46563d3b2ef1eb0854b05e"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
86582024-11-22T04:08:58.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
86592024-11-22T04:08:58.802ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
86602024-11-22T04:08:58.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
86612024-11-22T04:08:58.804ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4ce04a8f-a352-490b-94a2-239a377fc358 dns_zone_name = oxide.test found_so_far = 1 version = 2
86622024-11-22T04:08:58.804ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
86632024-11-22T04:08:58.804ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-22 03:55:08.993234 UTC dns_group = external generation = 2
86642024-11-22T04:08:58.804ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 366.36769ms iteration = 15 status = {"generation":2}
86652024-11-22T04:08:58.813ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 375.487152ms iteration = 29 status = {}
86662024-11-22T04:08:58.826ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
86672024-11-22T04:08:58.826ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 388.018584ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
86682024-11-22T04:08:58.827ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 389.47309ms iteration = 32 status = {"physical_disks_added":0}
86692024-11-22T04:08:58.867ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
86702024-11-22T04:08:58.867ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1001b2aa-4862-4f61-ba7e-58d35285be2a", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86712024-11-22T04:08:58.867ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86722024-11-22T04:08:58.869ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "beb3285f-14cb-4941-bd56-f2927da2b844", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86732024-11-22T04:08:58.869ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86742024-11-22T04:08:58.871ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7f459e59-fa6d-4470-970c-eb6284ce2506", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86752024-11-22T04:08:58.871ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86762024-11-22T04:08:58.873ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
86772024-11-22T04:08:58.873ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 435.236012ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
86782024-11-22T04:08:58.879ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86792024-11-22T04:08:58.879ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86802024-11-22T04:08:58.911ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86812024-11-22T04:08:58.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86822024-11-22T04:08:58.914ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
86832024-11-22T04:08:58.914ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86842024-11-22T04:08:58.914ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86852024-11-22T04:08:58.921ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "21698901-8231-4bb3-8c4a-950665ed7520", "content-length": "372", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
86862024-11-22T04:08:58.921ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86872024-11-22T04:08:58.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86882024-11-22T04:08:58.924ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
86892024-11-22T04:08:58.925ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfd0fccc-108c-4681-8c73-d577d83298fb", "content-length": "134", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
86902024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
86912024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
86922024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
86932024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
86942024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86952024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86962024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86972024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
86982024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
86992024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87002024-11-22T04:08:58.925ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
87012024-11-22T04:08:58.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87022024-11-22T04:08:58.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87032024-11-22T04:08:58.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87042024-11-22T04:08:58.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a746075-7b48-4b73-a824-1128c9cc0d09", "content-length": "2", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
87052024-11-22T04:08:58.928ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87062024-11-22T04:08:58.928ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "24992a2e-77ed-4949-8cdb-84209d0fa5c8", "content-length": "52", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
87072024-11-22T04:08:58.928ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
87082024-11-22T04:08:58.928ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87092024-11-22T04:08:58.979ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
87102024-11-22T04:08:58.979ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87112024-11-22T04:08:59.027ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "515fd70d-d985-473b-a017-ae8f030a5819", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
87122024-11-22T04:08:59.027ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
87132024-11-22T04:08:59.027ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87142024-11-22T04:08:59.028ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f3a22fd4-57c7-4797-9eec-d6b0af946e6d", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
87152024-11-22T04:08:59.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87162024-11-22T04:08:59.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87172024-11-22T04:08:59.028ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc6d2fdf-92f6-46e1-a318-37ea10887644", "content-length": "682", "date": "Fri, 22 Nov 2024 04:08:59 GMT"} })
87182024-11-22T04:08:59.028ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87192024-11-22T04:08:59.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87202024-11-22T04:08:59.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87212024-11-22T04:08:59.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87222024-11-22T04:08:59.032ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87232024-11-22T04:08:59.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87242024-11-22T04:08:59.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87252024-11-22T04:08:59.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87262024-11-22T04:08:59.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87272024-11-22T04:08:59.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87282024-11-22T04:08:59.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87292024-11-22T04:08:59.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87302024-11-22T04:08:59.038ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87312024-11-22T04:08:59.038ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87322024-11-22T04:08:59.038ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "9d285fe0-79b2-4531-842d-66a86d2aa075", "date": "Fri, 22 Nov 2024 04:08:58 GMT"} })
87332024-11-22T04:08:59.040ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 602.804266ms iteration = 30 status = {}
87342024-11-22T04:08:59.045ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 607.53559ms iteration = 29 status = {}
87352024-11-22T04:08:59.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08942e4d-ad65-4649-a93e-f09acdbfafb2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87362024-11-22T04:08:59.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08942e4d-ad65-4649-a93e-f09acdbfafb2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87372024-11-22T04:08:59.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 08942e4d-ad65-4649-a93e-f09acdbfafb2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87382024-11-22T04:09:00.533ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e54f3c9a-339f-42d5-b2c2-277637028149 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87392024-11-22T04:09:00.534ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e54f3c9a-339f-42d5-b2c2-277637028149 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87402024-11-22T04:09:00.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e54f3c9a-339f-42d5-b2c2-277637028149 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87412024-11-22T04:09:00.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 581 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 8131c6ef-2616-449b-b954-9800545ebcf4 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
87422024-11-22T04:09:01.554ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0fcbc69d-0580-425d-9b5d-57e447cbc629 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87432024-11-22T04:09:01.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0fcbc69d-0580-425d-9b5d-57e447cbc629 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87442024-11-22T04:09:01.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 0fcbc69d-0580-425d-9b5d-57e447cbc629 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87452024-11-22T04:09:02.576ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c26e102d-3abc-45de-8936-3e30a853bfb3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87462024-11-22T04:09:02.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c26e102d-3abc-45de-8936-3e30a853bfb3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87472024-11-22T04:09:02.578ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2336 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = c26e102d-3abc-45de-8936-3e30a853bfb3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87482024-11-22T04:09:03.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78f4441b-52b9-47fc-b087-0b42e95e1c9e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87492024-11-22T04:09:03.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78f4441b-52b9-47fc-b087-0b42e95e1c9e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87502024-11-22T04:09:03.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3061 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78f4441b-52b9-47fc-b087-0b42e95e1c9e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87512024-11-22T04:09:04.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3798fee4-c0d2-4133-8358-c794701ff924 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87522024-11-22T04:09:04.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3798fee4-c0d2-4133-8358-c794701ff924 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87532024-11-22T04:09:04.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2383 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 3798fee4-c0d2-4133-8358-c794701ff924 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87542024-11-22T04:09:05.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cf728194-20b2-4265-848c-ac6017de003f roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87552024-11-22T04:09:05.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cf728194-20b2-4265-848c-ac6017de003f resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87562024-11-22T04:09:05.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1882 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cf728194-20b2-4265-848c-ac6017de003f response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87572024-11-22T04:09:06.661ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 80c7b614-33ac-4c9f-b40d-074a0d4e6f35 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87582024-11-22T04:09:06.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 80c7b614-33ac-4c9f-b40d-074a0d4e6f35 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87592024-11-22T04:09:06.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2459 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 80c7b614-33ac-4c9f-b40d-074a0d4e6f35 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87602024-11-22T04:09:07.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14691f44-6f23-40af-8348-091075a94c93 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87612024-11-22T04:09:07.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14691f44-6f23-40af-8348-091075a94c93 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87622024-11-22T04:09:07.686ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2340 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14691f44-6f23-40af-8348-091075a94c93 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87632024-11-22T04:09:08.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
87642024-11-22T04:09:08.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87652024-11-22T04:09:08.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
87662024-11-22T04:09:08.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87672024-11-22T04:09:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87682024-11-22T04:09:08.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87692024-11-22T04:09:08.469ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87702024-11-22T04:09:08.469ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87712024-11-22T04:09:08.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87722024-11-22T04:09:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87732024-11-22T04:09:08.471ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87742024-11-22T04:09:08.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87752024-11-22T04:09:08.473ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87762024-11-22T04:09:08.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87772024-11-22T04:09:08.475ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87782024-11-22T04:09:08.477ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
87792024-11-22T04:09:08.477ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87802024-11-22T04:09:08.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87812024-11-22T04:09:08.489ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
87822024-11-22T04:09:08.489ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.586225ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
87832024-11-22T04:09:08.498ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.440853ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87842024-11-22T04:09:08.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b456da90-1263-4cac-b100-b80955134cd4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87852024-11-22T04:09:08.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b456da90-1263-4cac-b100-b80955134cd4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87862024-11-22T04:09:08.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b456da90-1263-4cac-b100-b80955134cd4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87872024-11-22T04:09:09.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 833c6a4b-b89c-4b1c-9ad5-3e87619f0b15 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87882024-11-22T04:09:09.727ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 833c6a4b-b89c-4b1c-9ad5-3e87619f0b15 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87892024-11-22T04:09:09.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2160 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 833c6a4b-b89c-4b1c-9ad5-3e87619f0b15 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87902024-11-22T04:09:10.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = da4fa5a3-c2b0-404e-9580-619d4fd2f6d7 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
87912024-11-22T04:09:10.747ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 563fa721-2f75-4ffb-9bdd-5ee8bd8d4c3c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87922024-11-22T04:09:10.748ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 563fa721-2f75-4ffb-9bdd-5ee8bd8d4c3c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87932024-11-22T04:09:10.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2179 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 563fa721-2f75-4ffb-9bdd-5ee8bd8d4c3c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87942024-11-22T04:09:11.768ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dbba77f9-cd43-4201-b4f0-910eb5423dfa roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87952024-11-22T04:09:11.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dbba77f9-cd43-4201-b4f0-910eb5423dfa resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87962024-11-22T04:09:11.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2263 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dbba77f9-cd43-4201-b4f0-910eb5423dfa response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87972024-11-22T04:09:12.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6e5351f-f58d-4ca3-a42c-b363bf475098 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87982024-11-22T04:09:12.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6e5351f-f58d-4ca3-a42c-b363bf475098 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
87992024-11-22T04:09:12.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d6e5351f-f58d-4ca3-a42c-b363bf475098 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88002024-11-22T04:09:13.811ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f9c4a96a-966c-4ec3-a677-bd943fe16fb4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88012024-11-22T04:09:13.811ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f9c4a96a-966c-4ec3-a677-bd943fe16fb4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88022024-11-22T04:09:13.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2199 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f9c4a96a-966c-4ec3-a677-bd943fe16fb4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88032024-11-22T04:09:14.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 54f806a2-b926-485b-9558-e6c9d543daf1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88042024-11-22T04:09:14.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 54f806a2-b926-485b-9558-e6c9d543daf1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88052024-11-22T04:09:14.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1917 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 54f806a2-b926-485b-9558-e6c9d543daf1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88062024-11-22T04:09:15.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68da66f7-fa88-4f8a-965b-e1eb192a7932 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88072024-11-22T04:09:15.852ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68da66f7-fa88-4f8a-965b-e1eb192a7932 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88082024-11-22T04:09:15.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2798 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 68da66f7-fa88-4f8a-965b-e1eb192a7932 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88092024-11-22T04:09:16.873ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5178ffa6-26dd-420f-90b3-b0c1b580bbb8 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88102024-11-22T04:09:16.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5178ffa6-26dd-420f-90b3-b0c1b580bbb8 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88112024-11-22T04:09:16.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2082 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5178ffa6-26dd-420f-90b3-b0c1b580bbb8 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88122024-11-22T04:09:17.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65d6ed7e-78b6-4506-af67-258627e94f73 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88132024-11-22T04:09:17.894ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65d6ed7e-78b6-4506-af67-258627e94f73 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88142024-11-22T04:09:17.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2463 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 65d6ed7e-78b6-4506-af67-258627e94f73 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88152024-11-22T04:09:18.437ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
88162024-11-22T04:09:18.437ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88172024-11-22T04:09:18.437ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
88182024-11-22T04:09:18.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88192024-11-22T04:09:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88202024-11-22T04:09:18.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88212024-11-22T04:09:18.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88222024-11-22T04:09:18.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88232024-11-22T04:09:18.467ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.569785ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88242024-11-22T04:09:18.468ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88252024-11-22T04:09:18.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88262024-11-22T04:09:18.470ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88272024-11-22T04:09:18.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88282024-11-22T04:09:18.472ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88292024-11-22T04:09:18.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88302024-11-22T04:09:18.474ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88312024-11-22T04:09:18.476ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
88322024-11-22T04:09:18.476ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88332024-11-22T04:09:18.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88342024-11-22T04:09:18.488ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
88352024-11-22T04:09:18.488ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.087029ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
88362024-11-22T04:09:18.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b74853d-6c64-4f64-94e5-cc5eebe17255 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88372024-11-22T04:09:18.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b74853d-6c64-4f64-94e5-cc5eebe17255 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88382024-11-22T04:09:18.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1728 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4b74853d-6c64-4f64-94e5-cc5eebe17255 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88392024-11-22T04:09:19.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 963a1839-fca5-4172-a491-eaf3777d4f7c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88402024-11-22T04:09:19.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 963a1839-fca5-4172-a491-eaf3777d4f7c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88412024-11-22T04:09:19.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2601 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 963a1839-fca5-4172-a491-eaf3777d4f7c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88422024-11-22T04:09:20.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 599 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 893b5ef3-87e3-4e35-ba8e-77d1852c6ae9 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
88432024-11-22T04:09:20.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b43ef939-1bfa-4369-9d87-da100efeaaeb roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88442024-11-22T04:09:20.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b43ef939-1bfa-4369-9d87-da100efeaaeb resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88452024-11-22T04:09:20.959ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2369 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b43ef939-1bfa-4369-9d87-da100efeaaeb response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88462024-11-22T04:09:21.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b13b3855-a8e8-449d-ad83-7a74eeefb278 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88472024-11-22T04:09:21.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b13b3855-a8e8-449d-ad83-7a74eeefb278 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88482024-11-22T04:09:21.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2448 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b13b3855-a8e8-449d-ad83-7a74eeefb278 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88492024-11-22T04:09:22.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd231de2-5c4c-4502-a57f-fdec8c79260c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88502024-11-22T04:09:22.999ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd231de2-5c4c-4502-a57f-fdec8c79260c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88512024-11-22T04:09:23.001ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2174 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = dd231de2-5c4c-4502-a57f-fdec8c79260c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88522024-11-22T04:09:24.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7d3b3a1f-8c79-4df1-ac90-427f7894f9f7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88532024-11-22T04:09:24.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7d3b3a1f-8c79-4df1-ac90-427f7894f9f7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88542024-11-22T04:09:24.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1895 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 7d3b3a1f-8c79-4df1-ac90-427f7894f9f7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88552024-11-22T04:09:25.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 05725e6c-d2d1-47c3-8ff7-dd6871bc08dc roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88562024-11-22T04:09:25.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 05725e6c-d2d1-47c3-8ff7-dd6871bc08dc resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88572024-11-22T04:09:25.044ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 05725e6c-d2d1-47c3-8ff7-dd6871bc08dc response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88582024-11-22T04:09:25.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 61f7ad4c-6686-4fd9-907b-d06b8e310883 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
88592024-11-22T04:09:25.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 61f7ad4c-6686-4fd9-907b-d06b8e310883 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
88602024-11-22T04:09:25.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3113 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 61f7ad4c-6686-4fd9-907b-d06b8e310883 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
88612024-11-22T04:09:25.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 062029c4-49be-4b4e-af30-2136b3610a0b roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
88622024-11-22T04:09:25.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 062029c4-49be-4b4e-af30-2136b3610a0b resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
88632024-11-22T04:09:25.632ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2439 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = 062029c4-49be-4b4e-af30-2136b3610a0b response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
88642024-11-22T04:09:25.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 61f8f8d0-0d7f-48af-bf41-7ff860b52ba2 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
88652024-11-22T04:09:25.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 61f8f8d0-0d7f-48af-bf41-7ff860b52ba2 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
88662024-11-22T04:09:25.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 61f8f8d0-0d7f-48af-bf41-7ff860b52ba2 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
88672024-11-22T04:09:26.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee885064-423f-4456-84be-49519a9d6987 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88682024-11-22T04:09:26.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee885064-423f-4456-84be-49519a9d6987 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88692024-11-22T04:09:26.065ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1790 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ee885064-423f-4456-84be-49519a9d6987 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88702024-11-22T04:09:27.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 148310e8-044d-4f1e-8571-f4a9174f66f5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88712024-11-22T04:09:27.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 148310e8-044d-4f1e-8571-f4a9174f66f5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88722024-11-22T04:09:27.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2184 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 148310e8-044d-4f1e-8571-f4a9174f66f5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88732024-11-22T04:09:28.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d7b73e1a-0cb2-4c2d-a5bc-ced1d2700bb1 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88742024-11-22T04:09:28.107ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d7b73e1a-0cb2-4c2d-a5bc-ced1d2700bb1 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88752024-11-22T04:09:28.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2114 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d7b73e1a-0cb2-4c2d-a5bc-ced1d2700bb1 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
88762024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
88772024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
88782024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88792024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88802024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
88812024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88822024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
88832024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88842024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
88852024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
88862024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88872024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
88882024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88892024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88902024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
88912024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 31 reason = Timeout
88922024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88932024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
88942024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88952024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
88962024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88972024-11-22T04:09:28.438ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88982024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
88992024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89002024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89012024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
89022024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89032024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
89042024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89052024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
89062024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
89072024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
89082024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
89092024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89102024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89112024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89122024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89132024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89142024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89152024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89162024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89172024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89182024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89192024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89202024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89212024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89222024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
89232024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89242024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89252024-11-22T04:09:28.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89262024-11-22T04:09:28.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89272024-11-22T04:09:28.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89282024-11-22T04:09:28.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89292024-11-22T04:09:28.441ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1797, tv_nsec: 792268571 } })
89302024-11-22T04:09:28.441ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
89312024-11-22T04:09:28.442ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.824237ms iteration = 30 status = {"errors":[],"records_set_to_done":[]}
89322024-11-22T04:09:28.442ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1797, tv_nsec: 792983994 } })
89332024-11-22T04:09:28.442ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.800747ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89342024-11-22T04:09:28.442ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89352024-11-22T04:09:28.442ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
89362024-11-22T04:09:28.442ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89372024-11-22T04:09:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89382024-11-22T04:09:28.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89392024-11-22T04:09:28.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89402024-11-22T04:09:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89412024-11-22T04:09:28.446ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89422024-11-22T04:09:28.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89432024-11-22T04:09:28.446ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89442024-11-22T04:09:28.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.57034ms iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
89452024-11-22T04:09:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89462024-11-22T04:09:28.448ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89472024-11-22T04:09:28.448ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89482024-11-22T04:09:28.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89492024-11-22T04:09:28.449ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89502024-11-22T04:09:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89512024-11-22T04:09:28.450ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89522024-11-22T04:09:28.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89532024-11-22T04:09:28.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89542024-11-22T04:09:28.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89552024-11-22T04:09:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89562024-11-22T04:09:28.452ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89572024-11-22T04:09:28.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89582024-11-22T04:09:28.453ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89592024-11-22T04:09:28.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89602024-11-22T04:09:28.454ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89612024-11-22T04:09:28.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89622024-11-22T04:09:28.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89632024-11-22T04:09:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
89642024-11-22T04:09:28.457ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89652024-11-22T04:09:28.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89662024-11-22T04:09:28.469ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
89672024-11-22T04:09:28.469ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.111912ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
89682024-11-22T04:09:28.472ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89692024-11-22T04:09:28.472ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89702024-11-22T04:09:28.472ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89712024-11-22T04:09:28.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89722024-11-22T04:09:28.473ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89732024-11-22T04:09:28.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89742024-11-22T04:09:28.477ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89752024-11-22T04:09:28.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89762024-11-22T04:09:28.478ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89772024-11-22T04:09:28.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89782024-11-22T04:09:28.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 41.470575ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89792024-11-22T04:09:28.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89802024-11-22T04:09:28.481ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89812024-11-22T04:09:28.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89822024-11-22T04:09:28.482ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89832024-11-22T04:09:28.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89842024-11-22T04:09:28.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89852024-11-22T04:09:28.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89862024-11-22T04:09:28.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89872024-11-22T04:09:28.486ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 48.106994ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89882024-11-22T04:09:28.487ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
89892024-11-22T04:09:28.487ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.950778ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
89902024-11-22T04:09:28.488ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-fcd04c0f-1471-4403-b8d9-fe281f829465.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1797, tv_nsec: 838956469 } })
89912024-11-22T04:09:28.488ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
89922024-11-22T04:09:28.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89932024-11-22T04:09:28.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89942024-11-22T04:09:28.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89952024-11-22T04:09:28.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89962024-11-22T04:09:28.495ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89972024-11-22T04:09:28.497ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89982024-11-22T04:09:28.497ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89992024-11-22T04:09:28.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90002024-11-22T04:09:28.512ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90012024-11-22T04:09:28.512ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90022024-11-22T04:09:28.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90032024-11-22T04:09:28.515ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: fcd04c0f-1471-4403-b8d9-fe281f829465, lookup_type: ById(fcd04c0f-1471-4403-b8d9-fe281f829465) } result = Ok(())
90042024-11-22T04:09:28.515ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90052024-11-22T04:09:28.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90062024-11-22T04:09:28.515ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90072024-11-22T04:09:28.515ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90082024-11-22T04:09:28.515ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90092024-11-22T04:09:28.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90102024-11-22T04:09:28.517ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 79.067173ms iteration = 30 status = 0
90112024-11-22T04:09:28.518ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.415257ms iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90122024-11-22T04:09:28.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90132024-11-22T04:09:28.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90142024-11-22T04:09:28.546ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 107.62213ms iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90152024-11-22T04:09:28.546ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90162024-11-22T04:09:28.546ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90172024-11-22T04:09:28.546ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.848384ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90182024-11-22T04:09:28.551ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 112.869683ms iteration = 33 status = {"physical_disks_added":0}
90192024-11-22T04:09:28.591ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 zone_address = fd00:1122:3344:101::2
90202024-11-22T04:09:28.591ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90212024-11-22T04:09:28.591ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddaeb69a-6ffd-4028-bfcf-1dae413fdac1", "content-length": "26", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90222024-11-22T04:09:28.591ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90232024-11-22T04:09:28.593ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
90242024-11-22T04:09:28.624ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90252024-11-22T04:09:28.624ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90262024-11-22T04:09:28.624ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fe65990-0288-4dd4-9e7a-2f0b3acc3e60", "content-length": "26", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90272024-11-22T04:09:28.624ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90282024-11-22T04:09:28.626ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90292024-11-22T04:09:28.626ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90302024-11-22T04:09:28.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90312024-11-22T04:09:28.627ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90322024-11-22T04:09:28.627ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90332024-11-22T04:09:28.628ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88c9610a-1077-433b-823a-4f3760f79dff", "content-length": "26", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90342024-11-22T04:09:28.628ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90352024-11-22T04:09:28.628ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90362024-11-22T04:09:28.629ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90372024-11-22T04:09:28.630ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90382024-11-22T04:09:28.630ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90392024-11-22T04:09:28.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90402024-11-22T04:09:28.632ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90412024-11-22T04:09:28.635ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90422024-11-22T04:09:28.635ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90432024-11-22T04:09:28.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90442024-11-22T04:09:28.763ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
90452024-11-22T04:09:28.763ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90462024-11-22T04:09:28.763ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.456145ms iteration = 30 status = {}
90472024-11-22T04:09:28.763ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "695415fc-6bef-48bb-aab0-c7d5866688cf", "content-length": "372", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90482024-11-22T04:09:28.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90492024-11-22T04:09:28.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90502024-11-22T04:09:28.808ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
90512024-11-22T04:09:28.808ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fac7b0de-d39a-4b71-a843-58a3f77a17f9", "content-length": "2", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90522024-11-22T04:09:28.810ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90532024-11-22T04:09:28.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
90542024-11-22T04:09:28.812ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.323892ms iteration = 30 status = null
90552024-11-22T04:09:28.815ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
90562024-11-22T04:09:28.815ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
90572024-11-22T04:09:28.816ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f8914292-e44f-4dbe-92da-a0232f805a94", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90582024-11-22T04:09:28.816ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90592024-11-22T04:09:28.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90602024-11-22T04:09:28.818ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90612024-11-22T04:09:28.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90622024-11-22T04:09:28.820ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
90632024-11-22T04:09:28.820ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb03c8e2-4d13-45ee-a05f-21c9dc68d30f", "content-length": "691", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90642024-11-22T04:09:28.820ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
90652024-11-22T04:09:28.820ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
90662024-11-22T04:09:28.820ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
90672024-11-22T04:09:28.820ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90682024-11-22T04:09:28.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90692024-11-22T04:09:28.822ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 384.243117ms iteration = 31 status = {}
90702024-11-22T04:09:28.824ZINFOnexus (BackgroundTasks): VPC route manager sled fcd04c0f-1471-4403-b8d9-fe281f829465 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
90712024-11-22T04:09:28.824ZDEBGnexus (BackgroundTasks): client request SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
90722024-11-22T04:09:28.824ZDEBGnexus (BackgroundTasks): client response SledAgent = fcd04c0f-1471-4403-b8d9-fe281f829465 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "208e28e3-a78b-45af-a794-496e115e53f7", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90732024-11-22T04:09:28.826ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 388.160828ms iteration = 31 status = {}
90742024-11-22T04:09:28.855ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90752024-11-22T04:09:28.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90762024-11-22T04:09:28.857ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 8c982de3-ef49-408d-998d-5a67e7ddcdb0, rack_id: cccdefe3-2bc4-4184-8dc4-7e505090a7b9, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(cc6379ce-237d-4ede-bb03-e926aaff79eb) } rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
90772024-11-22T04:09:28.857ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90782024-11-22T04:09:28.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90792024-11-22T04:09:28.865ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
90802024-11-22T04:09:28.866ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a927d135-8ae5-48b6-b8a6-3f16bed81a0a", "content-length": "134", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90812024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
90822024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = cc6379ce-237d-4ede-bb03-e926aaff79eb
90832024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
90842024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
90852024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90862024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90872024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90882024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90892024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
90902024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
90912024-11-22T04:09:28.866ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9
90922024-11-22T04:09:28.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90932024-11-22T04:09:28.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90942024-11-22T04:09:28.868ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
90952024-11-22T04:09:28.868ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "836319c3-3293-47ae-82c6-2d01857b3ace", "content-length": "2", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90962024-11-22T04:09:28.868ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
90972024-11-22T04:09:28.868ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad5dd0aa-3c4d-474b-bb81-fb9dab3d9a1f", "content-length": "52", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
90982024-11-22T04:09:28.869ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch_location = Switch0
90992024-11-22T04:09:28.869ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91002024-11-22T04:09:28.960ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4305ac33-659b-4d3e-96fe-208e991a598a", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
91012024-11-22T04:09:28.960ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 switch = Switch0
91022024-11-22T04:09:28.960ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91032024-11-22T04:09:28.960ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = cccdefe3-2bc4-4184-8dc4-7e505090a7b9 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8426c66c-914f-42a3-8754-1bf3070c5ae6", "content-length": "682", "date": "Fri, 22 Nov 2024 04:09:28 GMT"} })
91042024-11-22T04:09:28.960ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91052024-11-22T04:09:28.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91062024-11-22T04:09:28.963ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91072024-11-22T04:09:28.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91082024-11-22T04:09:28.967ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91092024-11-22T04:09:28.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91102024-11-22T04:09:28.970ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91112024-11-22T04:09:28.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91122024-11-22T04:09:28.977ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 538.735479ms iteration = 30 status = {}
91132024-11-22T04:09:29.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39a18cf5-c237-4a23-9a68-b5d1db23334e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91142024-11-22T04:09:29.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39a18cf5-c237-4a23-9a68-b5d1db23334e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91152024-11-22T04:09:29.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 39a18cf5-c237-4a23-9a68-b5d1db23334e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91162024-11-22T04:09:30.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = de160e7a-c8b5-4602-8aa5-4291734485e3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91172024-11-22T04:09:30.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = de160e7a-c8b5-4602-8aa5-4291734485e3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91182024-11-22T04:09:30.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2048 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = de160e7a-c8b5-4602-8aa5-4291734485e3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91192024-11-22T04:09:30.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 917 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 4fd564aa-61e1-4ea5-ab83-20786e272862 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
91202024-11-22T04:09:31.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f93e52e8-999c-44a2-bff5-1d9313006acd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91212024-11-22T04:09:31.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f93e52e8-999c-44a2-bff5-1d9313006acd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91222024-11-22T04:09:31.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = f93e52e8-999c-44a2-bff5-1d9313006acd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91232024-11-22T04:09:32.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e11c38c-da08-43f5-8921-23648f7c3e0c roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91242024-11-22T04:09:32.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e11c38c-da08-43f5-8921-23648f7c3e0c resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91252024-11-22T04:09:32.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2379 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 5e11c38c-da08-43f5-8921-23648f7c3e0c response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91262024-11-22T04:09:33.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 76959537-83be-4fec-8b64-60fd0b729341 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91272024-11-22T04:09:33.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 76959537-83be-4fec-8b64-60fd0b729341 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91282024-11-22T04:09:33.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2007 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 76959537-83be-4fec-8b64-60fd0b729341 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91292024-11-22T04:09:34.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9c9c8f7b-d82d-47df-b09d-83716e2a07f3 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91302024-11-22T04:09:34.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9c9c8f7b-d82d-47df-b09d-83716e2a07f3 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91312024-11-22T04:09:34.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2444 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9c9c8f7b-d82d-47df-b09d-83716e2a07f3 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91322024-11-22T04:09:35.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86ed06bc-8439-4bc1-a438-34f274aecfd5 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91332024-11-22T04:09:35.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86ed06bc-8439-4bc1-a438-34f274aecfd5 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91342024-11-22T04:09:35.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2516 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 86ed06bc-8439-4bc1-a438-34f274aecfd5 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91352024-11-22T04:09:36.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1dd84d0e-bfde-49a4-835c-9a85b20600ca roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91362024-11-22T04:09:36.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1dd84d0e-bfde-49a4-835c-9a85b20600ca resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91372024-11-22T04:09:36.284ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2271 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 1dd84d0e-bfde-49a4-835c-9a85b20600ca response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91382024-11-22T04:09:37.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db2d8070-c6b8-4c99-97f5-897f1acdcd00 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91392024-11-22T04:09:37.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db2d8070-c6b8-4c99-97f5-897f1acdcd00 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91402024-11-22T04:09:37.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2350 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = db2d8070-c6b8-4c99-97f5-897f1acdcd00 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91412024-11-22T04:09:38.326ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 155ec048-4d60-497f-aa7c-63511cc91f61 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91422024-11-22T04:09:38.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 155ec048-4d60-497f-aa7c-63511cc91f61 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91432024-11-22T04:09:38.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2106 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 155ec048-4d60-497f-aa7c-63511cc91f61 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91442024-11-22T04:09:38.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 89 reason = Timeout
91452024-11-22T04:09:38.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91462024-11-22T04:09:38.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 89 reason = Timeout
91472024-11-22T04:09:38.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91482024-11-22T04:09:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91492024-11-22T04:09:38.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91502024-11-22T04:09:38.440ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91512024-11-22T04:09:38.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91522024-11-22T04:09:38.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91532024-11-22T04:09:38.441ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.489242ms iteration = 89 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91542024-11-22T04:09:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91552024-11-22T04:09:38.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91562024-11-22T04:09:38.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91572024-11-22T04:09:38.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91582024-11-22T04:09:38.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91592024-11-22T04:09:38.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91602024-11-22T04:09:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
91612024-11-22T04:09:38.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91622024-11-22T04:09:38.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91632024-11-22T04:09:38.460ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
91642024-11-22T04:09:38.460ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.811698ms iteration = 89 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
91652024-11-22T04:09:39.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f26bba8-4f5c-4d9f-a485-c7daa2701d65 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91662024-11-22T04:09:39.348ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f26bba8-4f5c-4d9f-a485-c7daa2701d65 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91672024-11-22T04:09:39.350ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2211 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9f26bba8-4f5c-4d9f-a485-c7daa2701d65 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91682024-11-22T04:09:40.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14f6c6d1-28b6-420a-883f-af9dd9bb3b15 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91692024-11-22T04:09:40.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14f6c6d1-28b6-420a-883f-af9dd9bb3b15 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91702024-11-22T04:09:40.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2101 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 14f6c6d1-28b6-420a-883f-af9dd9bb3b15 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91712024-11-22T04:09:40.633ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 550 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = 5c964d8e-999a-48f6-9b7c-ce005afef9c8 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
91722024-11-22T04:09:41.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8726ff7d-4bd6-4311-9aa7-871eaba53f4b roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91732024-11-22T04:09:41.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8726ff7d-4bd6-4311-9aa7-871eaba53f4b resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91742024-11-22T04:09:41.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2208 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 8726ff7d-4bd6-4311-9aa7-871eaba53f4b response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91752024-11-22T04:09:42.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c132bcb-be63-4c9d-afc7-9f4722729103 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91762024-11-22T04:09:42.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c132bcb-be63-4c9d-afc7-9f4722729103 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91772024-11-22T04:09:42.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1856 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 4c132bcb-be63-4c9d-afc7-9f4722729103 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91782024-11-22T04:09:43.431ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d4e17d94-f861-4248-a143-e9746e52cfc4 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91792024-11-22T04:09:43.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d4e17d94-f861-4248-a143-e9746e52cfc4 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91802024-11-22T04:09:43.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2216 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = d4e17d94-f861-4248-a143-e9746e52cfc4 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91812024-11-22T04:09:44.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2d1c7254-8752-4bf7-ac05-bec337da8d45 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91822024-11-22T04:09:44.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2d1c7254-8752-4bf7-ac05-bec337da8d45 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91832024-11-22T04:09:44.455ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2385 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 2d1c7254-8752-4bf7-ac05-bec337da8d45 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91842024-11-22T04:09:45.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab41bbc6-3701-43f8-8afb-272323b1ffd7 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91852024-11-22T04:09:45.475ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab41bbc6-3701-43f8-8afb-272323b1ffd7 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91862024-11-22T04:09:45.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = ab41bbc6-3701-43f8-8afb-272323b1ffd7 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91872024-11-22T04:09:46.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e57b806b-5e06-49a0-b49b-60bbbe20717e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91882024-11-22T04:09:46.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e57b806b-5e06-49a0-b49b-60bbbe20717e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91892024-11-22T04:09:46.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2562 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = e57b806b-5e06-49a0-b49b-60bbbe20717e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91902024-11-22T04:09:47.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 315f604c-85eb-4840-89d5-2d9c27dcc800 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91912024-11-22T04:09:47.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 315f604c-85eb-4840-89d5-2d9c27dcc800 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91922024-11-22T04:09:47.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1970 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 315f604c-85eb-4840-89d5-2d9c27dcc800 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
91932024-11-22T04:09:48.438ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 90 reason = Timeout
91942024-11-22T04:09:48.438ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 90 reason = Timeout
91952024-11-22T04:09:48.438ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91962024-11-22T04:09:48.438ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91972024-11-22T04:09:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91982024-11-22T04:09:48.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91992024-11-22T04:09:48.440ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92002024-11-22T04:09:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92012024-11-22T04:09:48.443ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92022024-11-22T04:09:48.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92032024-11-22T04:09:48.445ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92042024-11-22T04:09:48.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92052024-11-22T04:09:48.447ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92062024-11-22T04:09:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 76e5932f-8d07-44e4-9a57-068f75ced7ea, lookup_type: ById(76e5932f-8d07-44e4-9a57-068f75ced7ea) } result = Ok(())
92072024-11-22T04:09:48.449ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92082024-11-22T04:09:48.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92092024-11-22T04:09:48.461ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea original_time_created = 2024-11-22 03:54:51.746592 UTC target_id = 76e5932f-8d07-44e4-9a57-068f75ced7ea time_created = 2024-11-22 03:54:51.746592 UTC
92102024-11-22T04:09:48.461ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.010428ms iteration = 90 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"76e5932f-8d07-44e4-9a57-068f75ced7ea","time_created":"2024-11-22T03:54:51.746592Z"}
92112024-11-22T04:09:48.468ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92122024-11-22T04:09:48.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92132024-11-22T04:09:48.470ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.097559ms iteration = 90 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92142024-11-22T04:09:48.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 483ebc50-9471-4c7a-99c6-e2696e75194e roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92152024-11-22T04:09:48.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 483ebc50-9471-4c7a-99c6-e2696e75194e resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92162024-11-22T04:09:48.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1812 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 483ebc50-9471-4c7a-99c6-e2696e75194e response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92172024-11-22T04:09:49.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fabdc9a1-6138-49fa-a812-f895272c2151 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92182024-11-22T04:09:49.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fabdc9a1-6138-49fa-a812-f895272c2151 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92192024-11-22T04:09:49.561ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = fabdc9a1-6138-49fa-a812-f895272c2151 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92202024-11-22T04:09:50.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78c7d868-d0bd-41d5-b2ca-f612f9620083 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92212024-11-22T04:09:50.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78c7d868-d0bd-41d5-b2ca-f612f9620083 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92222024-11-22T04:09:50.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3005 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 78c7d868-d0bd-41d5-b2ca-f612f9620083 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92232024-11-22T04:09:50.634ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 697 local_addr = [fd00:1122:3344:101::c]:35085 method = GET remote_addr = [fd00:1122:3344:101::d]:62065 req_id = cf6995d7-a7ca-400a-bd2a-e1c9946f5280 response_code = 200 uri = /8af2b85f-6ab3-4781-9033-075825f48255
92242024-11-22T04:09:51.603ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 655dbfb2-5ae5-4c35-8914-864d38009048 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92252024-11-22T04:09:51.603ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 655dbfb2-5ae5-4c35-8914-864d38009048 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92262024-11-22T04:09:51.605ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2301 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 655dbfb2-5ae5-4c35-8914-864d38009048 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92272024-11-22T04:09:52.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cec1d8af-4e66-4bdf-8e7a-767e04f0eb04 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92282024-11-22T04:09:52.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cec1d8af-4e66-4bdf-8e7a-767e04f0eb04 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92292024-11-22T04:09:52.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2137 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = cec1d8af-4e66-4bdf-8e7a-767e04f0eb04 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92302024-11-22T04:09:53.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ab71fae-93ec-431a-ac0e-3939331477f2 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92312024-11-22T04:09:53.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ab71fae-93ec-431a-ac0e-3939331477f2 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92322024-11-22T04:09:53.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 9ab71fae-93ec-431a-ac0e-3939331477f2 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92332024-11-22T04:09:54.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b9848855-a067-466b-b26f-941a86219e57 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92342024-11-22T04:09:54.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b9848855-a067-466b-b26f-941a86219e57 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92352024-11-22T04:09:54.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2270 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = b9848855-a067-466b-b26f-941a86219e57 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92362024-11-22T04:09:55.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = e5751bd0-be8f-42a2-a07d-ba4eb897e554 roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
92372024-11-22T04:09:55.627ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = e5751bd0-be8f-42a2-a07d-ba4eb897e554 resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
92382024-11-22T04:09:55.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3431 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = e5751bd0-be8f-42a2-a07d-ba4eb897e554 response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?sort_by=id_ascending
92392024-11-22T04:09:55.631ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = e97d3376-7079-4da3-bc06-d648da7bb27d roles = RoleSet { roles: {} } uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
92402024-11-22T04:09:55.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = e97d3376-7079-4da3-bc06-d648da7bb27d resource = Database result = Ok(()) uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
92412024-11-22T04:09:55.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2642 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43994 req_id = e97d3376-7079-4da3-bc06-d648da7bb27d response_code = 200 uri = /metrics/collectors/619dee3a-9d47-45ec-a665-d347c721dbd7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmY2QwNGMwZi0xNDcxLTQ0MDMtYjhkOS1mZTI4MWY4Mjk0NjUifX0%3D
92422024-11-22T04:09:55.686ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27e4b7ec-c2ab-41a7-827b-c147849514bd roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92432024-11-22T04:09:55.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27e4b7ec-c2ab-41a7-827b-c147849514bd resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92442024-11-22T04:09:55.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2515 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 27e4b7ec-c2ab-41a7-827b-c147849514bd response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92452024-11-22T04:09:55.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 03b22cd1-0304-4f65-87c1-e039e29aefe7 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/10?limit=100
92462024-11-22T04:09:55.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 03b22cd1-0304-4f65-87c1-e039e29aefe7 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/10?limit=100
92472024-11-22T04:09:55.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3582 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:47350 req_id = 03b22cd1-0304-4f65-87c1-e039e29aefe7 response_code = 200 uri = /nat/ipv4/changeset/10?limit=100
92482024-11-22T04:09:56.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a0c64c65-010f-4ecf-b8ea-62931655cfe6 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92492024-11-22T04:09:56.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a0c64c65-010f-4ecf-b8ea-62931655cfe6 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92502024-11-22T04:09:56.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2327 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = a0c64c65-010f-4ecf-b8ea-62931655cfe6 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92512024-11-22T04:09:57.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 013e02ed-aa5e-4652-b226-a7363ddbfc73 roles = RoleSet { roles: {} } uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92522024-11-22T04:09:57.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 013e02ed-aa5e-4652-b226-a7363ddbfc73 resource = Database result = Ok(()) uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465
92532024-11-22T04:09:57.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2149 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:42925 req_id = 013e02ed-aa5e-4652-b226-a7363ddbfc73 response_code = 200 uri = /probes/fcd04c0f-1471-4403-b8d9-fe281f829465